View as Markdown
DataForSEO icon

DataForSEO ACTION

Parse Page Content with OnPage

Parse the content on any page and return its structured content. See the documentation
  • Action
  • Writes data
  • API key
  • SDK
  • MCP

IMPLEMENTATION

Call this tool

Connect a user's DataForSEO account once, then configure and run Parse Page Content with OnPage from your backend or agent.

import { PipedreamClient } from "@pipedream/sdk"

const pd = new PipedreamClient({
  projectId: process.env.PIPEDREAM_PROJECT_ID!,
  clientId: process.env.PIPEDREAM_CLIENT_ID!,
  clientSecret: process.env.PIPEDREAM_CLIENT_SECRET!,
  projectEnvironment: "production",
})

const result = await pd.actions.run({
  id: "dataforseo-parse-page-content",
  externalUserId: "{external_user_id}", // any stable ID for this user in your system
  configuredProps: {
    dataforseo: { authProvisionId: "apn_xxxxxxx" },
    url: "URL",
    customUserAgent: "Custom User Agent",
  },
})

console.log(result)

SCHEMA

Inputs

Pipedream supplies the connected account. Your application provides the operation-specific values below. Dynamic inputs are resolved against that user's account.

Parse Page Content with OnPage inputs
Property Type Description
url URL string
The URL of the page to parse, e.g. https://pipedream.com/
Required
customUserAgent Custom User Agent string
Custom user agent for crawling a website. Default is Mozilla/5.0 (compatible; RSiteAuditor)
Optional
storeRawHtml Store Raw HTML boolean
Set to true if you want to get the HTML of the page using the [https://docs.dataforseo.com/v3/on_page/raw_html/](OnPage Raw HTML endpoint)
Optional
enableJavascript Enable Javascript boolean
Set to true if you want to load the scripts available on a page
Optional
additionalOptions Additional Options object
Additional parameters to send in the request. See the documentation for all available parameters. Values will be parsed as JSON where applicable.
Optional

REFERENCE

Tool details

Behavior hints are published with the component in the Pipedream registry and surface as MCP tool annotations, so an agent can reason about a tool before it calls it.

Registry key
dataforseo-parse-page-content
Version
0.0.5
App
DataForSEO
Authentication
API key
Read-only
No
Destructive
No
Open world
Yes