How to create your first Weave pipeline 

Build a Weave pipeline that imports data from a datasource, previews the result, and saves it for later scheduling or sharing. 

Before you begin 

You need: 

  • The Weave Designer role 
  • At least one Datasource already configured in your workspace 

Terminology worth knowing. In Datanyx, a pipeline (sometimes shown in the UI as a workflow) is a sequence of connected nodes that move and transform data. Every pipeline starts with a data import node — the source of the data. You then connect transform, ML, and destination nodes downstream. This article walks you through creating a pipeline with a single data import node, which is enough to verify your datasource connection and see the imported data. 

Steps 

Step 1. Open the Design tab 

From the main navigation bar, click Design. 

Step 2. Create a new Workflow 

Click the Add new icon, then click the Workflow icon. 

Step 3. Name and save the Workflow 

A pop-up appears asking you to name the Workflow. Enter a descriptive name and save.  

Step 4. Add a data import node to the canvas 

From the Data node palette, select the Data Import node. Drag and drop it onto the main canvas. 

Step 5. Understand the node’s action controls 

Click on the data import node you just placed. Three small action popups appear above it: 

  • Run — executes the node once you’ve finished configuring it 
  • Edit (pencil icon) — renames the node to something meaningful like Sales import 
  • Delete (cross icon) — removes the node from the canvas 

Step 6. Choose Datasource as the import type 

In the configuration panel on the right of the screen, find the Data Source Type dropdown and select Datasource. 

Worth knowing. Datasource is the simplest starting point, but it isn’t the only import type. You can also import from a Custom script, a Connector, or the result of another Data Workflow. See the related how-tos for each option. 

Step 7. Select the datasource to import from 

Click on the Select Data Source dropdown and choose the datasource you want to import from. 

If you need to narrow the import, use the additional filter options in the same panel to limit which records come through. 

Step 8. Run the pipeline 

Click the Run button to execute the import. 

Step 9. View the imported data 

Click Show Results. The imported data appears in a table. 

You can: 

  • Adjust column width by dragging the vertical separators between column headers 
  • Filter rows by clicking the filter icon in any column header. A multiselect dropdown appears with checkboxes and a search bar. You can filter multiple columns independently. Use Clear to reset a column’s filter. 

Important. After configuring a node, click Save to retain the changes. If you click away without saving or discarding, Datanyx shows a warning pop-up — your work isn’t lost, but you’ll need to explicitly choose Save or Discard before continuing. 

What a complete pipeline looks like 

A single data import node is a valid pipeline — useful for previewing a datasource. A real production pipeline chains more nodes together. Typical patterns: 

  • Import → Transform → Destination — the standard ETL shape 
  • Import → ML node → Destination — for workflows that run a model against incoming data 
  • Import → Custom script node → Destination — when built-in transforms don’t cover your logic 

To connect two nodes, click the tip of the first node and drag it to the second node. To run the full pipeline, click the Run button on the toolbar. Each node can also be configured from the panel on the right. 

Troubleshooting 

  • No data appears in Show Results. Confirm the datasource is in Active state. If its state is Failed or Partially imported, the connection needs to be fixed before data can flow. An Account Admin or Designer can check datasource health from Datasource Management. You can try running the entire workflow by clicking on the run button located on the tool bar.
  • I lost my changes when I clicked on another node. You either clicked Discard or dismissed the Save/Discard warning pop-up. Always click Save explicitly after configuring each node. 

Related 

  • How to import from a custom script 
  • How to import from a connector 
  • How to chain transform and destination nodes 
  • How to schedule a pipeline 
  • How to share a pipeline with other users 
  • How to run a pipeline on a cluster