Pipedream University

From zero to Workflow hero

Learn the basics of building workflows, integrating code steps, and all the way to building your own custom components on Pipedream.

The lessons are grouped into 3 main courses: Building workflows, Code steps and Component Development.

Each lesson is around 5 minutes long, perfect for watching during your lunch break or between deploys.

Developing Workflows

0.0 What is a workflow?


Get started here. Learn the basics of what a workflow is and how it works.

0.1 Build, test and deploy workflows


Learn the foundations of building, testing and deploying workflows. Once you master these concepts, you'll be able to build workflows from scratch using our hundreds of source-available pre-built triggers & actions.

0.2 Dive into the Workflow Inspector


Workflows include a queue system, performance monitoring and logs for your individual executions and steps. Monitor and troubleshoot our live workflows with the Workflow Inspector.

0.3 Trigger a Workflow


Learn how to use the various kinds of triggers to initiate your workflows. We'll cover the basic types of triggers, and how they open up possibilities for you to build workflows to boost your productivity.

0.4 Pass data between Workflow Steps


Connect the data produced from other steps in your workflow together with Step Exports. Step Exports are the "glue" that ties steps together. In this lesson we'll learn how to use Step Exports to log HTTP requests to a Google Sheet from our HTTP Webhook powered trigger.

0.5 Data Stores Basics


Data Stores are first class key value pair databases available in your Pipedream workflows. Learn how to use our pre-built actions to store & retrieve data in a Data Store that persists across all of your runs on your workflow or can be shared with other workflows.

0.6 Understanding Sources


Sources are key to understanding how workflows trigger. Learn how Sources emit events that power your workflows.

0.7 Connecting Accounts to Pipedream


To use the hundreds of pre-built actions or triggers available on Pipedream, you'll first need to connect your 3rd party service accounts. By connecting your account, you're authorizing Pipedream workflows to pull or push data on behalf of your connected account.

0.8 Conditionally stop workflows with Filters


There are times when you need to stop a workflow early or mid run in for certain conditions. Maybe you only need to run the workflow on active users, or only on fulfilled orders. The pre-built Filter action can help you do just that.

0.9 Delaying steps in Workflows


Sometimes you may need to delay steps in a given workflow. With the Delay pre-built action you can delay your workflow for a given period of hours, minutes, seconds or even milliseconds.

Code Steps

1.0 Pass data to code steps


Access your entire workflows' steps data in the steps object. Learn how to access step exports in a Node.js code step.

1.1 Use NPM packages in code steps


Learn how to use NPM packages like date-fns, moment, and axios in your Node.js code steps in your workflows. In this lesson, we go over a basic example of how to import a package and use it within a Node.js Code step.

1.2 Structure of a Node.js Code Step


Understand at a high level how Node.js components work in code steps, and how to leverage the built in utilities to quickly scaffold actions. Learn the very structure of a Node.js code step and get a brief tour of each of the functions and variables available for you to use or extend with.

1.3 Passing props to code steps


Take a peek under the hood and reveal the magic that is prop generation in Node.js code steps. Create your own fields from props in your Node.js steps to make your workflows more composable, flexible and user friendly.

1.4 Connecting apps to code steps


By using the same props functionality we covered in the last episode, you can actually integrate other apps into code steps. If you want to integrate with another API that features an OAuth handshake, you don't need to concern yourself with rotating access tokens, opening up a local tunnel to your program, or any of the other details with authentication.

1.5 Using asynchronous code in code steps


Make HTTP requests, Database queries, manipulate files and text using async actions in Code Steps.

1.6 Rerunning a code step


Use $.flow.rerun to poll an external service, or pause a workflow until another service or workflow activates your workflow again. Great for kicking off long running operations or jobs on other services, where you need to check back into their status. Even use this strategy with pagination iteration!

Component Development

2.0 Components 101


Pipedream is powered by components. Whether you've used pre-built actions or triggers, or even a Node.js code step you've actually interacted with components. We'll cover how components work from a high level, where to find the Pipedream source-available registry of components on Github and how they differ from Node.js code steps..

2.1 Installing the PD CLI tool


The Pipedream CLI tool is your gateway into developing components on the Pipedream platform. It's compatible with any operating system and architecture. After you install, simply run pd login to open up your browser to login.

2.2 Instant Component Development Environment with Gitpod


You can start developing your own components or modify any of the hundreds of Pipedream source-available components without installing any dependencies on your machine! Just open the link below to open up a new Component Development Environment with Gitpod.

2.3 Building your first action component


Action components are reusable code modules in your Pipedream workflows. Learn how to build and deploy your own action component to your account in less than 10 minutes.