Integrate the WebScraping.AI API with the Formatting API

Setup the WebScraping.AI API trigger to run a workflow which integrates with the Formatting API. Pipedream's integration platform allows you to integrate WebScraping.AI and Formatting remarkably fast. Free for developers.

Popular WebScraping.AI and Formatting Actions#

[Data] Convert JSON to String with the Formatting API

Convert an object to a JSON format string

Try it

[Data] Parse JSON with the Formatting API

Parse a JSON string

Try it

[Date/Time] Add/Subtract Time with the Formatting API

Add or subtract time from a given input

Try it

[Date/Time] Compare Dates with the Formatting API

Get the duration between two dates in days, hours, minutes, and seconds along with checking if they are the same.

Try it

[Date/Time] Format with the Formatting API

Format a date string to another date string

Try it

Overview of WebScraping.AI#

WebScraping.AI API provides powerful tools for extracting data from websites, enabling users to retrieve structured information without the hassle of setting up a custom scraper. It handles proxy rotation, browsers, and CAPTCHAs, allowing you to focus on data collection. With Pipedream, you can harness this capability to create automated workflows that trigger on various events, process web content, and connect with countless other apps to feed data pipelines, monitor changes, or populate databases.

Connect WebScraping.AI#

import { axios } from "@pipedream/platform"
export default defineComponent({
  props: {
    webscraping_ai: {
      type: "app",
      app: "webscraping_ai",
    }
  },
  async run({steps, $}) {
    return await axios($, {
      url: `https://api.webscraping.ai/account`,
      params: {
        api_key: `${this.webscraping_ai.$auth.api_key}`,
      },
    })
  },
})

Connect Formatting#

export default defineComponent({
  async run({ steps, $ }) {
    const text = ' Hello world! ';
    return text.trim()
  },
})