Instantly access web data with our patented AI-powered automated extraction API.
Go to siteimport { axios } from "@pipedream/platform"
export default defineComponent({
props: {
automatic_data_extraction: {
type: "app",
app: "automatic_data_extraction",
}
},
async run({steps, $}) {
const data = JSON.stringify([{
'url': 'http://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html',
'pageType': 'product',
}]);
return await axios($, {
method: "post",
url: `https://autoextract.scrapinghub.com/v1/extract`,
headers: {
"Content-Type": `application/json`,
},
auth: {
username: `${this.automatic_data_extraction.$auth.api_key}`,
password: ``,
},
data,
})
},
})
Extract data from a specified URL See the docs here
Automatic Data Extraction uses API keys for authentication. When you connect your Automatic Data Extraction account, Pipedream securely stores the keys so you can easily authenticate to Automatic Data Extraction APIs in both code and no-code steps.
To retrieve your API Key,