Octoparse icon

CONNECT APP

Build with Octoparse

Easy Web Scraping for Anyone. No code is the best code. Octoparse allows everyone to build reliable web scrapers they need - no coding needed.

Web & App Development

  • OAuth

MCP

Give your agent Octoparse tools

Every Octoparse action is exposed as an MCP tool on Pipedream's remote server. Point a client at it with your end user's ID and Connect resolves that user's Octoparse account for each tool call — you store no tokens.

// accessToken: mint a short-lived token with the Connect SDK — see the MCP guide
const transport = new StreamableHTTPClientTransport(
  new URL("https://remote.mcp.pipedream.net/v3"),
  {
    requestInit: {
      headers: {
        Authorization: `Bearer ${accessToken}`,
        "x-pd-project-id": "{project_id}",
        "x-pd-environment": "production",
        "x-pd-external-user-id": "{external_user_id}", // any stable ID for this user in your system
        "x-pd-app-slug": "octoparse",
      },
    },
  },
)

const mcp = new Client({ name: "my-agent", version: "1.0.0" })
await mcp.connect(transport)

const { tools } = await mcp.listTools()
// Every tool arrives with its own input schema — run one with mcp.callTool().

API PROXY

Call the Octoparse API directly

For an endpoint with no pre-built tool, the Connect proxy forwards your request to the Octoparse API with the connected user's credentials attached. You store no tokens and write no refresh logic.

const resp = await pd.proxy.get({
  externalUserId: "{external_user_id}", // any stable ID for this user in your system
  accountId: "apn_xxxxxxx",
  url: "https://openapi.octoparse.com/taskGroup",
})

// Any allowed Octoparse endpoint works here. Pipedream attaches the
// connected account's credentials to the outgoing request.

SDK

Run Octoparse actions from your backend

Connect a user's Octoparse account once, then discover and run its tools on their behalf from your own code — TypeScript, Python, or plain HTTP.

import { PipedreamClient } from "@pipedream/sdk"

const pd = new PipedreamClient({
  projectId: process.env.PIPEDREAM_PROJECT_ID!,
  clientId: process.env.PIPEDREAM_CLIENT_ID!,
  clientSecret: process.env.PIPEDREAM_CLIENT_SECRET!,
  projectEnvironment: "production",
})

const tools = await pd.components.list({
  app: "octoparse",
  componentType: "action",
})

TOOLS

Octoparse actions

On-demand operations your product or agent can configure and run on behalf of a connected user.

No Octoparse actions are available yet.

EVENTS

Octoparse triggers

Event sources your backend can deploy for users and receive through a webhook.

No Octoparse triggers are available yet.

MULTI-APP

Use Octoparse with other popular apps

Most products don't stop at one integration. Pair Octoparse with the other apps your users rely on, and ship use cases that span both.

REFERENCE

App details

Reference metadata for the Octoparse connector in the Pipedream registry.

App slug
octoparse
Authentication
OAuth
Categories
Web & App Development
Actions
0
Triggers
0
API proxy
Available