New Stories by Keyword from Hacker News API

Pipedream makes it easy to connect APIs for Hacker News and 2,000+ other apps remarkably fast.

Trigger workflow on

New Stories by Keyword from the Hacker News API

Next, do this

Connect to 2,000+ APIs using code and no-code building blocks

No credit card required

▶

Watch us build a workflow

4 min

Watch now ➜

Trusted by 800,000+ developers from startups to Fortune 500 companies

Developers ♥ Pipedream

Getting Started#

Trigger a workflow on New Stories by Keyword with Hacker News API. When you configure and deploy the workflow, it will run on Pipedream's servers 24x7 for free.

Configure the New Stories by Keyword trigger
1. Connect your Hacker News account
2. Configure timer
3. Optional- Configure Keyword
Add steps to connect to 2,000+ APIs using code and no-code building blocks
Deploy the workflow
Send a test event to validate your setup
Turn on the trigger

Integrations#

Send Message with Discord Webhook API on New Stories by Keyword from Hacker News API

Hacker News + Discord Webhook

Try it

Add Multiple Rows with Google Sheets API on New Stories by Keyword from Hacker News API

Hacker News + Google Sheets

Try it

Get Film with SWAPI API on New Stories by Keyword from Hacker News API

Hacker News + SWAPI - Star Wars

Try it

Create Multiple Records with Airtable API on New Stories by Keyword from Hacker News API

Hacker News + Airtable (API Key)

Try it

[Date/Time] Add/Subtract Time with Formatting API on New Stories by Keyword from Hacker News API

Hacker News + Formatting

Try it

Details#

This is a pre-built, source-available component from Pipedream's GitHub repo. The component is developed by Pipedream and the community, and verified and maintained by Pipedream.

To contribute an update to an existing component or create a new component, create a PR on GitHub. If you're new to Pipedream component development, you can start with quickstarts for trigger span and action development, and then review the component API reference.

New Stories by Keyword on Hacker News

Description:Emit new stories that mention a specific keyword

Version:0.0.4

Key:hacker_news-new-stories-by-keyword

View on GitHub

Code#

const Parser = require("rss-parser");
const hacker_news = require("../../hacker_news.app.js");
const { DEFAULT_POLLING_SOURCE_TIMER_INTERVAL } = require("@pipedream/platform");

const parser = new Parser();

module.exports = {
  key: "hacker_news-new-stories-by-keyword",
  name: "New Stories by Keyword",
  description: "Emit new stories that mention a specific keyword",
  version: "0.0.4",
  type: "source",
  props: {
    hacker_news,
    timer: {
      type: "$.interface.timer",
      default: {
        intervalSeconds: DEFAULT_POLLING_SOURCE_TIMER_INTERVAL,
      },
    },
    db: "$.service.db",
    // If you want a single search feed but multiple keywords, separate the keywords with " OR ":
    keyword: {
      type: "string",
      label: "Keyword",
      description: "Keyword to watch. Matches story titles. Leave blank to get all stories.",
      optional: true,
      default: "",
    },
  },
  methods: {
    // in theory if alternate setting title and description or aren't unique this won't work
    itemKey(item) {
      return item.guid || item.id || item.title || item.description;
    },
  },
  async run() {
    const seenKeys = this.db.get("seenKeys") || [];
    const seenKeysMap = seenKeys.reduce((acc, v) => {
      acc[v] = true;
      return acc;
    }, {});
    // All elements of an item are optional,
    // however at least one of title or description must be present.
    // should be listed from most recent to least recent
    const feed = await parser.parseURL(`https://hnrss.org/newest?q=${encodeURIComponent(this.keyword)}`);
    for (let idx = feed.items.length - 1; idx >= 0; idx--) {
      const item = feed.items[idx];
      const key = this.itemKey(item);
      // XXX throw if !key?
      if (seenKeysMap[key]) continue;
      seenKeys.unshift(key);
      seenKeysMap[key] = true; // just in case of dupes
      this.$emit(item, {
        id: this.itemKey(item),
        summary: item.title,
        ts: item.pubdate && +new Date(item.pubdate),
      });
    }
    if (seenKeys.length) {
      // XXX restrict by byte size instead of el size
      this.db.set("seenKeys", seenKeys.slice(0, 1000));
    }
  },
};

Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI and CLI.

Label	Prop	Type	Description
Hacker News	`hacker_news`	`app`	This component uses the Hacker News app.
	`timer`	`$.interface.timer`
N/A	`db`	`$.service.db`	This component uses `$.service.db` to maintain state between executions.
Keyword	`keyword`	`string`	Keyword to watch. Matches story titles. Leave blank to get all stories.