View as Markdown
ScrapingBot icon

ScrapingBot ACTION

Request Social Media Scraping

Use ScrapingBot API to initiate scraping data from a social media site. See the documentation
  • Action
  • Writes data
  • API key
  • SDK
  • MCP

IMPLEMENTATION

Call this tool

Connect a user's ScrapingBot account once, then configure and run Request Social Media Scraping from your backend or agent.

import { PipedreamClient } from "@pipedream/sdk"

const pd = new PipedreamClient({
  projectId: process.env.PIPEDREAM_PROJECT_ID!,
  clientId: process.env.PIPEDREAM_CLIENT_ID!,
  clientSecret: process.env.PIPEDREAM_CLIENT_SECRET!,
  projectEnvironment: "production",
})

const result = await pd.actions.run({
  id: "scrapingbot-request-social-media-scraping",
  externalUserId: "{external_user_id}", // any stable ID for this user in your system
  configuredProps: {
    scrapingbot: { authProvisionId: "apn_xxxxxxx" },
    scraper: "Scraper",
    url: "URL",
  },
})

console.log(result)

SCHEMA

Inputs

Pipedream supplies the connected account. Your application provides the operation-specific values below. Dynamic inputs are resolved against that user's account.

Request Social Media Scraping inputs
Property Type Description
scraper Scraper string
the name of the scraper you want to use
Required
url URL string
URL of the page you want to scrape
Optional
account Account string
The account name you want to extract data from
Optional
search Search string
The term to search for
Optional
hashtag Hashtag string
The hashtag you wish to extract data from
Optional

REFERENCE

Tool details

Behavior hints are published with the component in the Pipedream registry and surface as MCP tool annotations, so an agent can reason about a tool before it calls it.

Registry key
scrapingbot-request-social-media-scraping
Version
0.0.2
App
ScrapingBot
Authentication
API key
Read-only
No
Destructive
No
Open world
Yes