Pipedream

Integration platform for developers

Integrate the Pipedream API with the ScrapeNinja API

Setup the Pipedream API trigger to run a workflow which integrates with the ScrapeNinja API. Pipedream's integration platform allows you to integrate Pipedream and ScrapeNinja remarkably fast. Free for developers.

New Scheduled Tasks from the Pipedream API

Exposes an HTTP API for scheduling messages to be emitted at a future time

 
Try it
Upcoming Event Alert from the Pipedream API

Triggers based on a time interval before an upcoming event in the calendar. This source uses Pipedream's Task Scheduler. See here for more information and instructions for connecting your Pipedream account.

 
Try it
Create a Subscription with the Pipedream API

Create a Subscription. See Doc

 
Try it
Delete a Subscription with the Pipedream API

Delete a Subscription. See Doc

 
Try it
Get Component with the Pipedream API

Get info for a published component. See docs

 
Try it

Overview of Pipedream

Pipedream is an API that allows you to build applications that can connect to
various data sources and processes them in real-time. You can use Pipedream to
create applications that can perform ETL (Extract, Transform, and Load) tasks,
as well as to create data-driven workflows.

Some examples of applications you can build using the Pipedream API include:

  • An application that can extract data from a database, transform it, and then
    load it into another database.
  • An application that can monitor a data source for changes, and then trigger a
    workflow in response to those changes.
  • An application that can poll an API for new data, and then process that data
    in real-time.

Connect Pipedream

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
import { axios } from "@pipedream/platform"
export default defineComponent({
  props: {
    pipedream: {
      type: "app",
      app: "pipedream",
    }
  },
  async run({steps, $}) {
    return await axios($, {
      url: `https://api.pipedream.com/v1/users/me`,
      headers: {
        Authorization: `Bearer ${this.pipedream.$auth.api_key}`,
      },
    })
  },
})

Connect ScrapeNinja

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
import { axios } from '@pipedream/platform';

export default defineComponent({
  props: {
    scrapeninja: {
      type: "app",
      app: "scrapeninja",
    }
  },
  async run({steps, $}) {
    return await axios($, {
      method: 'POST',
      url: 'https://scrapeninja.p.rapidapi.com/scrape',
      headers: {
        'content-type': 'application/json',
        'X-RapidAPI-Key': this.scrapeninja.$auth.rapid_api_key,
        'X-RapidAPI-Host': 'scrapeninja.p.rapidapi.com'
      },
      data: {
        url:"https://news.ycombinator.com/"
      }
    })
  },
})