with Automatic Data Extraction and Perplexity?
Extract data from a specified URL See the docs here
Generates a model's response for the given chat conversation. See the documentation
The Automatic Data Extraction API by Zyte specializes in extracting structured data from web pages. When incorporated into Pipedream workflows, this API allows you to automate the process of gathering web data, which can feed into various tasks such as market research, price monitoring, or even lead generation. By triggering workflows with new data inputs, processing and storing the extracted data, and connecting to other apps, Pipedream amplifies the API's utility.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
automatic_data_extraction: {
type: "app",
app: "automatic_data_extraction",
}
},
async run({steps, $}) {
const data = JSON.stringify([{
'url': 'http://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html',
'pageType': 'product',
}]);
return await axios($, {
method: "post",
url: `https://autoextract.scrapinghub.com/v1/extract`,
headers: {
"Content-Type": `application/json`,
},
auth: {
username: `${this.automatic_data_extraction.$auth.api_key}`,
password: ``,
},
data,
})
},
})
The Perplexity API offers advanced natural language processing capabilities, enabling users to generate answers, summaries, and insights from texts. Leveraging this API on Pipedream allows for the automation of content analysis, intelligent alert systems, and dynamic data enrichment, integrating seamlessly with various data sources and services for real-time processing.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
perplexity: {
type: "app",
app: "perplexity",
}
},
async run({steps, $}) {
const data = {
"model": "mistral-7b-instruct",
"messages": [
{
"role": "system",
"content": "Be precise and concise."
},
{
"role": "user",
"content": "Can you tell me about the integration platform called Pipedream?"
}
]
}
return await axios($, {
method: "post",
url: `https://api.perplexity.ai/chat/completions`,
headers: {
Authorization: `Bearer ${this.perplexity.$auth.api_key}`,
"accept": `application/json`,
},
data,
})
},
})