Create Monitor with Wachete API on New Question for Specific Keywords from Stack Exchange (Stack Overflow) API

Pipedream makes it easy to connect APIs for Wachete, Stack Exchange (Stack Overflow) and 2,700+ other apps remarkably fast.

Trigger workflow on

New Question for Specific Keywords from the Stack Exchange (Stack Overflow) API

Next, do this

Create Monitor with the Wachete API

No credit card required

▶

Watch us build a workflow

8 min

Watch now ➜

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Developers ♥ Pipedream

Getting Started#

This integration creates a workflow with a Stack Exchange (Stack Overflow) trigger and Wachete action. When you configure and deploy the workflow, it will run on Pipedream's servers 24x7 for free.

Select this integration
Configure the New Question for Specific Keywords trigger
1. Connect your Stack Exchange (Stack Overflow) account
2. Select a Site
3. Configure Keywords
4. Configure timer
Configure the Create Monitor action
1. Connect your Wachete account
2. Configure Name
3. Configure URL
4. Select a Job Type
5. Optional- Configure Notification Endpoint
6. Optional- Configure Notification Email
Deploy the workflow
Send a test event to validate your setup
Turn on the trigger

Details#

This integration uses pre-built, source-available components from Pipedream's GitHub repo. These components are developed by Pipedream and the community, and verified and maintained by Pipedream.

To contribute an update to an existing component or create a new component, create a PR on GitHub. If you're new to Pipedream component development, you can start with quickstarts for trigger span and action development, and then review the component API reference.

Trigger#

New Question for Specific Keywords on Stack Exchange (Stack Overflow)

Description:Emits an event when a new question is posted and related to a set of specific keywords

Version:0.0.3

Key:stack_exchange-new-question-for-keywords

View on GitHub

Stack Exchange (Stack Overflow) Overview#

The Stack Exchange API provides programmatic access to Stack Overflow and other sites on the Stack Exchange network. With this API, you can fetch questions, answers, comments, user profiles, and other data that enables you to integrate Stack Exchange's wealth of knowledge and community activities into your own applications. Using Pipedream, you can harness this data to create custom workflows that react to events on Stack Exchange, compile reports, or even automate interactions, providing a powerful tool for developers, data analysts, and content creators.

Trigger Code#

const stack_exchange = require("../../stack_exchange.app");
const { DEFAULT_POLLING_SOURCE_TIMER_INTERVAL } = require("@pipedream/platform");

module.exports = {
  key: "stack_exchange-new-question-for-keywords",
  name: "New Question for Specific Keywords",
  description:
    "Emits an event when a new question is posted and related to a set of specific keywords",
  version: "0.0.3",
  dedupe: "unique",
  type: "source",
  props: {
    stack_exchange,
    db: "$.service.db",
    siteId: {
      propDefinition: [
        stack_exchange,
        "siteId",
      ],
    },
    keywords: {
      propDefinition: [
        stack_exchange,
        "keywords",
      ],
    },
    timer: {
      type: "$.interface.timer",
      default: {
        intervalSeconds: DEFAULT_POLLING_SOURCE_TIMER_INTERVAL,
      },
    },
  },
  hooks: {
    async activate() {
      const fromDate = this._getCurrentEpoch();
      this.db.set("fromDate", fromDate);
    },
  },
  methods: {
    _getCurrentEpoch() {
      // The StackExchange API works with Unix epochs in seconds.
      return Math.floor(Date.now() / 1000);
    },
    generateMeta(data) {
      const {
        question_id: id, creation_date: ts, title,
      } = data;
      const summary = `New question: ${title}`;
      return {
        id,
        summary,
        ts,
      };
    },
  },
  async run() {
    const fromDate = this.db.get("fromDate");
    const toDate = this._getCurrentEpoch();
    const keywordsQuery = this.keywords.join(",");
    const searchParams = {
      fromDate,
      toDate,
      sort: "creation",
      order: "asc",
      closed: false,
      site: this.siteId,
      q: keywordsQuery,
    };

    const items = this.stack_exchange.advancedSearch(searchParams);
    for await (const item of items) {
      const meta = this.generateMeta(item);
      this.$emit(item, meta);
    }

    this.db.set("fromDate", toDate);
  },
};

Trigger Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI and CLI.

Label	Prop	Type	Description
Stack Exchange (Stack Overflow)	`stack_exchange`	`app`	This component uses the Stack Exchange (Stack Overflow) app.
N/A	`db`	`$.service.db`	This component uses `$.service.db` to maintain state between executions.
Site	`siteId`	`string`	Select a value from the drop down menu.
Keywords	`keywords`	`string[]`	Keywords to search for in questions
	`timer`	`$.interface.timer`

Trigger Authentication#

Stack Exchange (Stack Overflow) uses OAuth authentication. When you connect your Stack Exchange (Stack Overflow) account, Pipedream will open a popup window where you can sign into Stack Exchange (Stack Overflow) and grant Pipedream permission to connect to your account. Pipedream securely stores and automatically refreshes the OAuth tokens so you can easily authenticate any Stack Exchange (Stack Overflow) API.

Pipedream requests the following authorization scopes when you connect your account:

read_inboxno_expirywrite_accessprivate_info

About Stack Exchange (Stack Overflow)#

Community-powered Q&A sites, including Stack Overflow

Action#

Create Monitor on Wachete

Description:Creates a new monitor for a specific website or web page. [See the documentation(https://api.wachete.com/swagger/ui/index/index.html)

Version:0.0.1

Key:wachete-create-monitor

View on GitHub

Wachete Overview#

The Wachete API lets you track changes in web content and get notified when updates happen. This is handy for monitoring websites for new content, price changes, or availability of products, without manually checking the sites. Using Pipedream, you can integrate Wachete with other apps to automate reactions to these updates. Think about monitoring your competitors’ sites, keeping tabs on industry news, or even watching for job postings. With Wachete on Pipedream, these tasks become set-and-forget operations.

Action Code#

import wachete from "../../wachete.app.mjs";

export default {
  key: "wachete-create-monitor",
  name: "Create Monitor",
  description: "Creates a new monitor for a specific website or web page. [See the documentation(https://api.wachete.com/swagger/ui/index/index.html)",
  version: "0.0.1",
  type: "action",
  props: {
    wachete,
    name: {
      type: "string",
      label: "Name",
      description: "Name of the new Wachet",
    },
    url: {
      type: "string",
      label: "URL",
      description: "The URL to watch",
    },
    jobType: {
      type: "string",
      label: "Job Type",
      description: "Type of monitoring job. \"SinglePage\" watches a single URL, while \"Portal\" can be used for crawling",
      options: [
        "SinglePage",
        "Portal",
      ],
      reloadProps: true,
    },
    notificationEndpoint: {
      type: "string",
      label: "Notification Endpoint",
      description: "URL to receive webhook notifications",
      optional: true,
    },
    notificationEmail: {
      type: "string",
      label: "Notification Email",
      description: "Email address to receive notifications at",
      optional: true,
    },
  },
  async additionalProps() {
    const props = {};
    if (this.jobType === "Portal") {
      props.crawlingDepth = {
        type: "integer",
        label: "Crawling Depth",
        description: "How deep to crawl. Must be between 1 - 3",
        default: 2,
      };
    }
    return props;
  },
  async run({ $ }) {
    const notificationEndpoints = [];
    if (this.notificationEndpoint) {
      notificationEndpoints.push({
        type: "Webhook",
        value: this.notificationEndpoint,
      });
    }
    if (this.notificationEmail) {
      notificationEndpoints.push({
        type: "Email",
        value: this.notificationEmail,
      });
    }
    const response = await this.wachete.createOrUpdateMonitor({
      $,
      data: {
        name: this.name,
        url: this.url,
        notificationEndpoints,
        jobType: this.jobType,
        crawlingDepth: this.crawlingDepth,
        alerts: [
          {
            type: "Error",
          },
          {
            type: "NotEq",
          },
        ],
      },
    });

    $.export("$summary", `Successfully created Wachet with ID ${response.id}`);
    return response;
  },
};

Action Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI.

Label	Prop	Type	Description
Wachete	`wachete`	`app`	This component uses the Wachete app.
Name	`name`	`string`	Name of the new Wachet
URL	`url`	`string`	The URL to watch
Job Type	`jobType`	`string`	Select a value from the drop down menu:`SinglePagePortal`
Notification Endpoint	`notificationEndpoint`	`string`	URL to receive webhook notifications
Notification Email	`notificationEmail`	`string`	Email address to receive notifications at

Action Authentication#

Wachete uses OAuth authentication. When you connect your Wachete account, Pipedream will open a popup window where you can sign into Wachete and grant Pipedream permission to connect to your account. Pipedream securely stores and automatically refreshes the OAuth tokens so you can easily authenticate any Wachete API.

Pipedream requests the following authorization scopes when you connect your account: