Octoparse API Integrations

Build and run workflows using the Octoparse API. Use 1000s of source-available triggers and actions across 2,000+ apps. Or write custom code to integrate any app or API in seconds.

Overview#

The Octoparse API allows you to automate the extraction of web data without coding, making it a powerful tool for data-driven workflows. With this API, you can control your scraping tasks, retrieve extracted data, and manage your account programmatically. When combined with Pipedream's serverless execution environment, you can build custom workflows to process, store, or act upon the data fetched by Octoparse. This integration can be a cornerstone for solutions in market research, competitor analysis, price monitoring, or lead generation.

import { axios } from "@pipedream/platform"
export default defineComponent({
  props: {
    octoparse: {
      type: "app",
      app: "octoparse",
    }
  },
  async run({steps, $}) {
    return await axios($, {
      url: `https://openapi.octoparse.com/taskGroup`,
      headers: {
        Authorization: `Bearer ${this.octoparse.$auth.oauth_access_token}`,
      },
    })
  },
})

Example Use Cases#

Automated Data Collection to Google Sheets: Trigger a scraping task in Octoparse and, upon completion, send the extracted data to Google Sheets. This workflow is ideal for users needing regular updates for market research or competitive analysis without manual intervention.
Lead Generation with CRM Integration: Use Octoparse to scrape contact information from target websites and automatically add these leads to a CRM platform like Salesforce. This workflow streamlines the process of expanding your sales funnel with fresh prospects.
Price Monitoring and Alerts: Set Octoparse to track product prices on e-commerce websites and, using Pipedream, create a workflow that sends alerts via email or Slack if prices drop below a specified threshold. This can be an asset for businesses monitoring pricing strategies or for consumers looking for deals.

Authentication#

Octoparse uses OAuth authentication. When you connect your Octoparse account, Pipedream will open a popup window where you can sign into Octoparse and grant Pipedream permission to connect to your account. Pipedream securely stores and automatically refreshes the OAuth tokens so you can easily authenticate any Octoparse API.

Pipedream requests the following authorization scopes when you connect your account:

OAuth Request Configurations:

accessToken
POSThttps://openapi.octoparse.com/tokenContent-Type: application/json
username={{custom_fields.username}}&password={{custom_fields.password}}&grant_type=password
refreshToken
POSThttps://openapi.octoparse.com/tokencontent-type: application/json
grant_type=refresh_token&refresh_token={{custom_fields.refresh_token}}

Octoparse

Octoparse API Integrations

Build and run workflows using the Octoparse API. Use 1000s of source-available triggers and actions across 2,000+ apps. Or write custom code to integrate any app or API in seconds.

Overview#

Choose an API to Connect with Octoparse API#

1
-
24
of
2,000+
apps by most popular

Example Use Cases#

Authentication#

Octoparse

Octoparse API Integrations

Build and run workflows using the Octoparse API. Use 1000s of source-available triggers and actions across 2,000+ apps. Or write custom code to integrate any app or API in seconds.

Overview#

Choose an API to Connect with Octoparse API#

1-24of2,000+apps by most popular

Example Use Cases#

Authentication#

1
-
24
of
2,000+
apps by most popular