with Proxy Spider and Mistral AI?
Emit new event when a new batch job is completed. See the Documentation
Emit new event when a new batch job fails. See the Documentation
Emit new event when a new AI model is registered or becomes available. See the Documentation
Create a new batch job, it will be queued for processing. See the Documentation
Download a batch job results file to the /tmp directory. See the Documentation
Get the details of a batch job by its ID. See the Documentation
The Proxy Spider API lets you scrape and gather data from the web without the usual hassle of IP blocks or CAPTCHAs. By leveraging Pipedream's integration capabilities, you can automate the extraction of web data and manage proxy pools seamlessly. This means you can focus on what to do with the data you gather, rather than worrying about the technicalities of acquiring it. Within Pipedream's serverless platform, you could set up workflows that trigger based on a variety of events and use the Proxy Spider API to fetch data as needed.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
proxy_spider: {
type: "app",
app: "proxy_spider",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://proxy-spider.com/api/proxies.json`,
params: {
api_key: `${this.proxy_spider.$auth.api_key}`,
},
})
},
})
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
mistral_ai: {
type: "app",
app: "mistral_ai",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.mistral.ai/v1/models`,
headers: {
Authorization: `Bearer ${this.mistral_ai.$auth.api_key}`,
"content-type": `application/json`,
},
})
},
})