with Scrape-It.Cloud and Gemini Public?
Initiate the scraping process for a specific endpoint. See the documentation here
The Scrape-It.Cloud API allows you to automate the extraction of data from websites. It can parse, scrape, and retrieve content without the need for manual intervention. With this API on Pipedream, you can build workflows that trigger on various events and use the scraped data for numerous applications like data analysis, lead generation, and content aggregation.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
scrape_it_cloud: {
type: "app",
app: "scrape_it_cloud",
}
},
async run({steps, $}) {
const data = {
"url": `https://pipedream.com`,
}
return await axios($, {
method: "post",
url: `https://api.scrape-it.cloud/scrape`,
headers: {
"Content-Type": `application/json`,
"x-api-key": `${this.scrape_it_cloud.$auth.api_key}`,
},
data,
})
},
})
The Gemini Public API provides a gateway to interact with Gemini, a cryptocurrency exchange platform, allowing users to access market data, such as current prices, volume, and order book information. Through Pipedream, developers can harness this data to build powerful, serverless workflows that react to market changes, automate trading analysis, and integrate cryptocurrency data into external applications or services.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
gemini_public: {
type: "app",
app: "gemini_public",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.gemini.com/v1/symbols`,
})
},
})