Parallel

Overview

Parallel is multi-path branching operator. It allows you to create multiple execution branches with optional filtering rules and Pipedream will execute all matching branches. Unlike Switch and If/Else, the order in which rules are defined will not affect the path of execution.

Capabilities

• Create non-linear workflows that execute steps in parallel branches
• Define when branches run — always, conditionally or never (to disable a branch)
• Merge and continue execution in the parent flow after the branching operation

Add Parallel operator to workflow

Select Parallel from the Control Flow section of the step selector:

Create Branches

To create new branches, click the + button:

Rename Branches

Edit the branch’s nameslug on the canvas or in the right pane after selecting the Start phase of the parallel block. The nameslug communicates the branch’s purpose and affects workflow execution—the end phase exports an object, with each key corresponding to a branch name.

Export Data to the Parent Flow

You can export data from a parallel operation and continue execution in the parent flow.

• The parallel block exports data as a JSON object
• Branch exports are assigned to a key corresponding to the branch name slug (in the object exported from the block)
• Only the exports from the last step of each executed branch are included in the parallel block’s return value
• To preview the exported data, test the End phase of the parallel block

Beta Limitations

Workflow queue settings (concurrency, execution rate) may not work as expected with workflows using the parallel operator.

Getting Started