with Looker and Automatic Data Extraction?
Extract data from a specified URL See the docs here
The Looker API provides programmatic access to Looker's data exploration functionalities, allowing you to tap into your data analytics and share insights across your organization dynamically. With the Looker API on Pipedream, you can automate reporting, synchronize analytics data with other apps, and trigger data-driven workflows. Whether it's scheduling reports, updating dashboards, or integrating data insights into other systems, the Looker API empowers you to make data-informed decisions efficiently.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
looker: {
type: "app",
app: "looker",
}
},
async run({steps, $}) {
return await axios($, {
url: `${this.looker.$auth.looker_base_url}/api/4.0/user`,
headers: {
"Authorization": `token ${this.looker.$auth.oauth_access_token}`,
},
})
},
})
The Automatic Data Extraction API by Zyte specializes in extracting structured data from web pages. When incorporated into Pipedream workflows, this API allows you to automate the process of gathering web data, which can feed into various tasks such as market research, price monitoring, or even lead generation. By triggering workflows with new data inputs, processing and storing the extracted data, and connecting to other apps, Pipedream amplifies the API's utility.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
automatic_data_extraction: {
type: "app",
app: "automatic_data_extraction",
}
},
async run({steps, $}) {
const data = JSON.stringify([{
'url': 'http://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html',
'pageType': 'product',
}]);
return await axios($, {
method: "post",
url: `https://autoextract.scrapinghub.com/v1/extract`,
headers: {
"Content-Type": `application/json`,
},
auth: {
username: `${this.automatic_data_extraction.$auth.api_key}`,
password: ``,
},
data,
})
},
})