with Browserless and Function?
The Browserless API on Pipedream allows you to automate browser actions without the overhead of managing your own browser infrastructure. This service provides a way to run Chrome browser sessions programmatically, making it ideal for web scraping, automated testing, and screenshot capture. Leveraging this on Pipedream, you can create serverless workflows that interact with web pages, extract data, and perform actions as a human would, all in a scalable and efficient manner.
import puppeteer from 'puppeteer-core@14.1.0';
export default defineComponent({
props: {
browserless: {
type: "app",
app: "browserless",
}
},
async run({steps, $}) {
// See the browserless docs for more info:
// https://www.browserless.io/docs/
const browser = await puppeteer.connect({
browserWSEndpoint: `wss://chrome.browserless.io?token=${this.browserless.$auth.api_key}`
})
const page = await browser.newPage()
const url = "https://example.com"
const type = "png"
await page.goto(url)
const screenshot = await page.screenshot()
// export the base64-encoded screenshot for use in future steps,
// along with the image type and filename
$.export("screenshot", Buffer.from(screenshot, 'binary').toString('base64'))
$.export("type", type)
$.export("filename",`${url.replace(/[&\/\\#, +()$~%.'":*?<>{}]/g, '_')}-${+new Date()}.${type}`)
await browser.close()
},
})
The Function API allows you to run code snippets in various programming languages directly through API calls. This capability can extend Pipedream workflows by enabling custom logic processing, data transformation, or any operation that requires server-side code execution without deploying or managing servers. By using the Function API, you can incorporate code that's beyond the native actions available within Pipedream, offering a flexible and powerful way to handle complex tasks in your automations.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
function: {
type: "app",
app: "function",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.fxn.ai/user`,
headers: {
Authorization: `Bearer ${this.function.$auth.api_key}`,
},
})
},
})