🎉 Pipedream raises $20M Series A 🎉
Read the blog post and TC Techcrunch article.
← GitHub + RSS integrations

Group or Merge multiple RSS Feeds with RSS APIon New Branch (Instant) from GitHub API

Pipedream makes it easy to connect APIs for RSS, GitHub and 700+ other apps remarkably fast.

Trigger workflow on
New Branch (Instant) from the GitHub API
Next, do this
Group or Merge multiple RSS Feeds with the RSS API
No credit card required
Into to Pipedream
Watch us build a workflow
Watch us build a workflow
7 min
Watch now ➜
Trusted by 250,000+ developers from startups to Fortune 500 companies:
Trusted by 250,000+ developers from startups to Fortune 500 companies

Developers Pipedream

Getting Started

This integration creates a workflow with a GitHub trigger and RSS action. When you configure and deploy the workflow, it will run on Pipedream's servers 24x7 for free.

  1. Select this integration
  2. Configure the New Branch (Instant) trigger
    1. Connect your GitHub account
    2. Select a Repo
  3. Configure the Group or Merge multiple RSS Feeds action
    1. Connect your RSS account
    2. Configure Feed URLs
    3. Optional- Configure Merge
  4. Deploy the workflow
  5. Send a test event to validate your setup
  6. Turn on the trigger

Details

This integration uses pre-built, open source components from Pipedream's GitHub repo. These components are developed by Pipedream and the community, and verified and maintained by Pipedream.

To contribute an update to an existing component or create a new component, create a PR on GitHub. If you're new to Pipedream component development, you can start with quickstarts for trigger span and action development, and then review the component API reference.

Trigger

Description:Emit new events when a new branch is created
Version:0.0.6
Key:github-new-branch

Trigger Code

const common = require("../common-webhook.js");
const eventTypes = [
  "branch",
];

module.exports = {
  ...common,
  key: "github-new-branch",
  name: "New Branch (Instant)",
  description: "Emit new events when a new branch is created",
  version: "0.0.6",
  dedupe: "unique",
  type: "source",
  methods: {
    getEventNames() {
      return [
        "create",
      ];
    },
    generateMeta(data) {
      const ts = Date.now();
      return {
        id: `${data.repository.id}${ts}`,
        summary: `New Branch: ${data.ref} by ${data.sender.login}`,
        ts,
      };
    },
    emitEvent(body) {
      if (eventTypes.indexOf(body.ref_type) > -1) {
        const meta = this.generateMeta(body);
        this.$emit(body, meta);
      }
    },
  },
};

Trigger Configuration

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI and CLI.
LabelPropTypeDescription
GitHubgithubappThis component uses the GitHub app.
ReporepoFullNamestringSelect a value from the drop down menu.
N/Ahttp$.interface.httpThis component uses $.interface.http to generate a unique URL when the component is first instantiated. Each request to the URL will trigger the run() method of the component.
N/Adb$.service.dbThis component uses $.service.db to maintain state between component invocations.

Trigger Authentication

GitHub uses OAuth authentication. When you connect your GitHub account, Pipedream will open a popup window where you can sign into GitHub and grant Pipedream permission to connect to your account. Pipedream securely stores and automatically refreshes the OAuth tokens so you can easily authenticate any GitHub API.

Pipedream requests the following authorization scopes when you connect your account:

repoadmin:orgadmin:public_keyadmin:org_hookgistnotificationsuserwrite:discussionwrite:packagesread:packages

About GitHub

Where the world builds software. Millions of developers and companies build, ship, and maintain their software on GitHub—the largest and most advanced development platform in the world.

Action

Description:Retrieve multiple RSS feeds and return it grouped or merged into an array of items sorted by date.
Version:0.0.2
Key:rss-merge-rss-feeds

Action Code

import rssApp from "../../rss.app.mjs";
import Parser from "rss-parser";

export default {
  name: "Group or Merge multiple RSS Feeds",
  description: "Retrieve multiple RSS feeds and return it grouped or merged into an array of items sorted by date.",
  key: "rss-merge-rss-feeds",
  version: "0.0.2",
  type: "action",
  props: {
    rssApp,
    urls: {
      type: "string[]",
      label: "Feed URLs",
      description: "Enter either one or multiple URLs from any public RSS feed.\n\n**Example:** `[\"https://rss.nytimes.com/services/xml/rss/nyt/HomePage.xml\", \"https://www.theguardian.com/uk/technology/rss\"]`",
    },
    merge: {
      label: "Merge",
      type: "boolean",
      optional: true,
      default: true,
      description: "If `true`, all items are returned in a date sorted array. If `false`, each feed is returned as one result in the array.",
    },
  },
  methods: {
    ...rssApp.methods,
    getFeedDetails(feedResult) {
      return {
        title: feedResult.title,
        description: feedResult.description,
        lastBuildDate: feedResult.lastBuildDate,
        link: feedResult.link,
        feedUrl: feedResult.feedUrl,
      };
    },
    mergedResult(feeds) {
      let result = [];
      feeds.map((feedResult) => {
        const feed = this.getFeedDetails(feedResult);
        const innerResult = feedResult.items.map((item) => {
          return {
            feed,
            ...item,
          };
        });
        result = [
          ...result,
          ...innerResult,
        ];
      });
      result = result.sort((a, b) => {
        let aDate = new Date(a.isoDate);
        let bDate = new Date(b.isoDate);
        return bDate - aDate;
      });
      return result;
    },
    groupedResult(feeds) {
      let result = feeds.map((feedResult) => {
        const feed = this.getFeedDetails(feedResult);
        return {
          feed,
          items: feedResult.items,
        };
      });
      return result;
    },
  },
  async run() {
    /*
      1. If merge is true, each item will be placed into an array, a property { feed }
      will be added containing info on the feed, it will be sorted by date.
      2. If merge is false, each item will be grouped and placed into an array of feeds:
      [{ feed, items }, { feed, items }]
    */

    let parser = new Parser();
    const requests = this.urls.map((feedUrl) => parser.parseURL(feedUrl));
    const feeds = await Promise.all(requests);

    if (this.merge) {
      return this.mergedResult(feeds);
    } else {
      return this.groupedResult(feeds);
    }
  },
};

Action Configuration

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI.

LabelPropTypeDescription
RSSrssAppappThis component uses the RSS app.
Feed URLsurlsstring[]

Enter either one or multiple URLs from any public RSS feed.

Example: ["https://rss.nytimes.com/services/xml/rss/nyt/HomePage.xml", "https://www.theguardian.com/uk/technology/rss"]

Mergemergeboolean

If true, all items are returned in a date sorted array. If false, each feed is returned as one result in the array.

Action Authentication

The RSS API does not require authentication.

About RSS

Real Simple Syndication