with Schedule and Webscrape AI?
Scrape the provided URL and store the results in the system. See the documentation
The Schedule app in Pipedream is a powerful tool that allows you to trigger workflows at regular intervals, ranging from every minute to once a year. This enables the automation of repetitive tasks and the scheduling of actions to occur without manual intervention. By leveraging this API, you can execute code, run integrations, and process data on a reliable schedule, all within Pipedream's serverless environment.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
webscrape_ai: {
type: "app",
app: "webscrape_ai",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.webscrapeai.com/scrapeWebSite`,
params: {
url: `https://news.ycombinator.com/`,
command: `I want to extract all the news details`,
apiKey: `${this.webscrape_ai.$auth.api_key}`,
schema: `{"author":"string","comments_count":"integer","points":"integer","posted_time":"string","title":"string","url":"url"}`,
},
})
},
})