🎉 Pipedream raises $20M Series A 🎉

Read the blog post and TC Techcrunch article.

Explore Pricing Support Docs Community Blog Careers (we're hiring!)

← GitHub + RSS integrations

Group or Merge multiple RSS Feeds with RSS APIon New Branch (Instant) from GitHub API

Pipedream makes it easy to connect APIs for RSS, GitHub and 700+ other apps remarkably fast.

Trigger workflow on

New Branch (Instant) from the GitHub API

Next, do this

Group or Merge multiple RSS Feeds with the RSS API

No credit card required

▶

Watch us build a workflow

7 min

Watch now ➜

Trusted by 250,000+ developers from startups to Fortune 500 companies:

Developers ♥ Pipedream

Getting Started#

This integration creates a workflow with a GitHub trigger and RSS action. When you configure and deploy the workflow, it will run on Pipedream's servers 24x7 for free.

Select this integration
Configure the New Branch (Instant) trigger
1. Connect your GitHub account
2. Select a Repo
Configure the Group or Merge multiple RSS Feeds action
1. Connect your RSS account
2. Configure Feed URLs
3. Optional- Configure Merge
Deploy the workflow
Send a test event to validate your setup
Turn on the trigger

Details#

This integration uses pre-built, open source components from Pipedream's GitHub repo. These components are developed by Pipedream and the community, and verified and maintained by Pipedream.

To contribute an update to an existing component or create a new component, create a PR on GitHub. If you're new to Pipedream component development, you can start with quickstarts for trigger span and action development, and then review the component API reference.

Trigger#

New Branch (Instant) on GitHub

Description:Emit new events when a new branch is created

Version:0.0.6

Key:github-new-branch

View on GitHub

Trigger Code#

const common = require("../common-webhook.js");
const eventTypes = [
  "branch",
];

module.exports = {
  ...common,
  key: "github-new-branch",
  name: "New Branch (Instant)",
  description: "Emit new events when a new branch is created",
  version: "0.0.6",
  dedupe: "unique",
  type: "source",
  methods: {
    getEventNames() {
      return [
        "create",
      ];
    },
    generateMeta(data) {
      const ts = Date.now();
      return {
        id: `${data.repository.id}${ts}`,
        summary: `New Branch: ${data.ref} by ${data.sender.login}`,
        ts,
      };
    },
    emitEvent(body) {
      if (eventTypes.indexOf(body.ref_type) > -1) {
        const meta = this.generateMeta(body);
        this.$emit(body, meta);
      }
    },
  },
};

Trigger Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI and CLI.

Label	Prop	Type	Description
GitHub	`github`	`app`	This component uses the GitHub app.
Repo	`repoFullName`	`string`	Select a value from the drop down menu.
N/A	`http`	`$.interface.http`	This component uses `$.interface.http` to generate a unique URL when the component is first instantiated. Each request to the URL will trigger the `run()` method of the component.
N/A	`db`	`$.service.db`	This component uses `$.service.db` to maintain state between component invocations.

Trigger Authentication#

GitHub uses OAuth authentication. When you connect your GitHub account, Pipedream will open a popup window where you can sign into GitHub and grant Pipedream permission to connect to your account. Pipedream securely stores and automatically refreshes the OAuth tokens so you can easily authenticate any GitHub API.

Pipedream requests the following authorization scopes when you connect your account:

repoadmin:orgadmin:public_keyadmin:org_hookgistnotificationsuserwrite:discussionwrite:packagesread:packages

About GitHub#

Where the world builds software. Millions of developers and companies build, ship, and maintain their software on GitHub—the largest and most advanced development platform in the world.

Action#

Group or Merge multiple RSS Feeds on RSS

Description:Retrieve multiple RSS feeds and return it grouped or merged into an array of items sorted by date.

Version:0.0.2

Key:rss-merge-rss-feeds

View on GitHub

Action Code#

import rssApp from "../../rss.app.mjs";
import Parser from "rss-parser";

export default {
  name: "Group or Merge multiple RSS Feeds",
  description: "Retrieve multiple RSS feeds and return it grouped or merged into an array of items sorted by date.",
  key: "rss-merge-rss-feeds",
  version: "0.0.2",
  type: "action",
  props: {
    rssApp,
    urls: {
      type: "string[]",
      label: "Feed URLs",
      description: "Enter either one or multiple URLs from any public RSS feed.\n\n**Example:** `[\"https://rss.nytimes.com/services/xml/rss/nyt/HomePage.xml\", \"https://www.theguardian.com/uk/technology/rss\"]`",
    },
    merge: {
      label: "Merge",
      type: "boolean",
      optional: true,
      default: true,
      description: "If `true`, all items are returned in a date sorted array. If `false`, each feed is returned as one result in the array.",
    },
  },
  methods: {
    ...rssApp.methods,
    getFeedDetails(feedResult) {
      return {
        title: feedResult.title,
        description: feedResult.description,
        lastBuildDate: feedResult.lastBuildDate,
        link: feedResult.link,
        feedUrl: feedResult.feedUrl,
      };
    },
    mergedResult(feeds) {
      let result = [];
      feeds.map((feedResult) => {
        const feed = this.getFeedDetails(feedResult);
        const innerResult = feedResult.items.map((item) => {
          return {
            feed,
            ...item,
          };
        });
        result = [
          ...result,
          ...innerResult,
        ];
      });
      result = result.sort((a, b) => {
        let aDate = new Date(a.isoDate);
        let bDate = new Date(b.isoDate);
        return bDate - aDate;
      });
      return result;
    },
    groupedResult(feeds) {
      let result = feeds.map((feedResult) => {
        const feed = this.getFeedDetails(feedResult);
        return {
          feed,
          items: feedResult.items,
        };
      });
      return result;
    },
  },
  async run() {
    /*
      1. If merge is true, each item will be placed into an array, a property { feed }
      will be added containing info on the feed, it will be sorted by date.
      2. If merge is false, each item will be grouped and placed into an array of feeds:
      [{ feed, items }, { feed, items }]
    */

    let parser = new Parser();
    const requests = this.urls.map((feedUrl) => parser.parseURL(feedUrl));
    const feeds = await Promise.all(requests);

    if (this.merge) {
      return this.mergedResult(feeds);
    } else {
      return this.groupedResult(feeds);
    }
  },
};

Action Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI.

Label	Prop	Type	Description
RSS	`rssApp`	`app`	This component uses the RSS app.
Feed URLs	`urls`	`string[]`	Enter either one or multiple URLs from any public RSS feed. Example: `["https://rss.nytimes.com/services/xml/rss/nyt/HomePage.xml", "https://www.theguardian.com/uk/technology/rss"]`
Merge	`merge`	`boolean`	If `true`, all items are returned in a date sorted array. If `false`, each feed is returned as one result in the array.