Integrate the Octoparse API with the Pipedream Utils API

Setup the Octoparse API trigger to run a workflow which integrates with the Pipedream Utils API. Pipedream's integration platform allows you to integrate Octoparse and Pipedream Utils remarkably fast. Free for developers.

Start for free — no credit card required

Watch a demo

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Popular Octoparse and Pipedream Utils Actions#

Formatting - [Data] Convert JSON to String with the Pipedream Utils API

Convert an object to a JSON format string

Try it

Formatting - [Data] Parse JSON with the Pipedream Utils API

Parse a JSON string

Try it

Formatting - [Date/Time] Add/Subtract Time with the Pipedream Utils API

Add or subtract time from a given input

Try it

Formatting - [Date/Time] Compare Dates with the Pipedream Utils API

Get the duration between two dates in days, hours, minutes, and seconds along with checking if they are the same.

Try it

Formatting - [Date/Time] Format with the Pipedream Utils API

Format a date string to another date string. For more examples on formatting, see the Sugar Date Format documentation.

Try it

Overview of Octoparse#

The Octoparse API allows you to automate the extraction of web data without coding, making it a powerful tool for data-driven workflows. With this API, you can control your scraping tasks, retrieve extracted data, and manage your account programmatically. When combined with Pipedream's serverless execution environment, you can build custom workflows to process, store, or act upon the data fetched by Octoparse. This integration can be a cornerstone for solutions in market research, competitor analysis, price monitoring, or lead generation.

Connect Octoparse#

import { axios } from "@pipedream/platform"
export default defineComponent({
  props: {
    octoparse: {
      type: "app",
      app: "octoparse",
    }
  },
  async run({steps, $}) {
    return await axios($, {
      url: `https://openapi.octoparse.com/taskGroup`,
      headers: {
        Authorization: `Bearer ${this.octoparse.$auth.oauth_access_token}`,
      },
    })
  },
})

Overview of Pipedream Utils#

The Pipedream Utils app is a set of pre-built functions that streamline common tasks in your workflows. It acts like a Swiss Army knife for developers, providing essential tools such as format conversion, date manipulation, and text processing. By leveraging these functions, you can reduce the boilerplate code needed for routine operations, speeding up the development of intricate automations. The Helper Functions API can be a game changer when it comes to tasks like parsing dates in user-friendly formats, encoding and decoding data, or generating UUIDs, making them more efficient and less error-prone.

Connect Pipedream Utils#

export default defineComponent({
  props: {
    pipedream_utils: {
      type: "app",
      app: "pipedream_utils",
    }
  },
  async run({steps, $}) {

  },
})

Start for free — no credit card required

Watch a demo