Quickstart
Use GitHub Sync

Quickstart - Github Sync

The purpose of this guide is to help you start building projects on Pipedream using GitHub Sync.

This guide assumes you:

  • Have a Pipedream account
  • Have a GitHub account
  • Understand the basics of workflow development on Pipedream
  • Are familiar with git-concepts (branches, commits, merges, etc)
  • Are on an eligible plan

If you are new to Pipedream, we recommend starting with the basics of workflow development.

Users on the Free and Basic plan may preview GitHub Sync by enabling the feature when creating a new project. You will not be able to merge to production without upgrading. When you upgrade, you may enable or disable GitHub sync for projects at any time.

Create a new project

Follow the steps below to create a new project and configure GitHub Sync.

This example uses Pipedream's OAuth integration with GitHub which will automaticallly create a a new, empty repo in GitHub. The OAuth integration requires the granting of extensive scopes so Pipedream can create and manage the integration. If you prefer not to use OAuth and configure the integration manually, follow the steps in Pipedream's docs to configure the integration using deploy keys. Deploy keys allow you to restrict Pipedream's access to a specific repo.

Visit https://pipedream.com/projects and click on Create Project.

github

Enter a project name or click the icon to generate a random name and check the box to Configure GitHub Sync.

github

Select or connect a GitHub account, username and repo name and click Create Project.

github

Create a branch to make edits

Once your project is ready, click on the Edit button.

github

Since this is a new project, you will prompted to create a branch. You may accept the default branch name or customize it.

github

In the future, when you click Edit, Pipedream will load development mode for the last branch you were editing for the project. You may also create or select a different branch from the drop down menu.

When GitHub Sync is enabled, project resources may only be edited in a branch.

Create a workflow in the editable branch

Once the branch is created, click the New button to create a workflow.

github

For this example, name the workflow and click Create Workflow to use the default settings.

github

Build a simple workflow with an HTTP trigger and Node code step.

github

At this point, your workflow is saved, but changes have not been commited to GitHub. To do that, click on the dropdown menu and select Commit.

github

You may add an option commit message and complete the commit.

github

Next, make an edit to the code (e.g., add a comment). Commit your changes again. Notice that the commit diff highlights the specific changes that will be committed.

github

View your project on GitHub

Open the Git actions menu and select View branch on GitHub.

github

You can explore the files created, including the YAML file with the workflow definition and the javascript file with the code for the Node step.

github

Optionally navigate to the file with the code step and make an edit to the file and commit your changes to the branch (e.g., add another comment). When you return to Pipedream, you'll notice the git actions button will prompt you to pull changes. Pipedream's integration with GitHub is bi-directional, so you can make edits outside of Pipedream (including locally) and sync them via GitHub. Note: there are currently restrictions on local development (e.g., you can only edit existing resources -- you can't create new workflows locally).

Merge your changes to production

Merge to production to deploy the workflow to Pipedream.

github

Pipedream will show you the full diff of all commited changes and the current state of Production. When your changes are merged, Pipedream will route you to the production branch for the project where you can view and inspect live, running workflows and events.

github

NOTE: When you merge, changes for all resources in the project will be merged. That means one or more workflows may be updated, enabled, disabled, etc.

Edit a previously merged branch

To edit a previously merged branch, you may create a new branch or click Edit when viewing the productionto continue editing the last used branch.

github

Open the workflow in Pipedream's editor and add an HTTP request action to the end of the workflow. Configure the action to GET the URL https://example.com.

github

This time, we'll merge directly to production without commiting separately. Click Merge to Production to view the diff, commit and merge.

github

You may also view the repo on GitHub to see how the action configuration is represented in the YAML of the workflow definition. Try other actions, including actions that use connected accounts and explore how they're represented in the GitHub code.

Make an edit and merge from GitHub

As the final step of this quickstart, view the repository on GitHub and navigate to the code step. Click the edit icon and made a simple change (e.g., add a comment).

github

Commit and create a PR.

github

Then open the PR, review the changes and merge.

github

When you return to Pipedream, the changes will be merged to production and deployed.

github

Use the changelog

If you have any issues, including errors when merging or deploying, check the changelog. It communicates the state of all operations from both Pipedream and GitHub and will surface errors and issues (including where actions were initiated from and by whom).

github

More resources

We hope that helps you get started syncing projects with GitHub. Next, we suggest reading the docs and exploring the feature in more depth. If you have any issues or feedback, please reach out.