Integrate the Puppeteer API with the Data Stores API

Setup the Puppeteer API trigger to run a workflow which integrates with the Data Stores API. Pipedream's integration platform allows you to integrate Puppeteer and Data Stores remarkably fast. Free for developers.

Start for free — no credit card required

Watch a demo

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Popular Puppeteer and Data Stores Actions#

Get HTML with the Puppeteer API

Get the HTML of a webpage using Puppeteer. See the documentation for details.

Try it

Add or update a single record with the Data Stores API

Add or update a single record in your Pipedream Data Store.

Try it

Get Page Title with the Puppeteer API

Get the title of a webpage using Puppeteer. See the documentation

Try it

Add or update multiple records with the Data Stores API

Add or update multiple records to your Pipedream Data Store.

Try it

Get PDF with the Puppeteer API

Generate a PDF of a page using Puppeteer. See the documentation

Try it

Overview of Puppeteer#

Puppeteer is a Node.js library which provides a high-level API to control Chrome/Chromium over the DevTools Protocol. Puppeteer runs in headless mode on Chromium on Pipedream.

Using Puppeteer you can perform tasks including:

Capture Screenshots: Convert webpages into images.
Processing PDFs: parse and scan PDFs.
Web Scraping: Extract data from websites.
UI/UX Testing: Verify user interface and experience.
Integration with Test Frameworks: Combine with testing frameworks.
Task Automation: Automate web-related tasks like form filling.
Functional Testing: Automate user interactions to test web application functionality.
Regression Testing: Ensure new code changes don't introduce bugs.

Connect Puppeteer#

 import { puppeteer } from '@pipedream/browsers';

export default defineComponent({
  async run({steps, $}) {
    const browser = await puppeteer.browser();
    
    // Interact with the web page programmatically
    // See Puppeeter's Page documentation for available methods:
    // https://pptr.dev/api/puppeteer.page
    const page = await browser.newPage();

    await page.goto('https://pipedream.com/');
    const title = await page.title();
    const content = await page.content();

    // The browser needs to be closed, otherwise the step will hang
    await browser.close();

    return { title, content }
  },
})

Overview of Data Stores#

Data Stores are a key-value store that allow you to persist state and share data across workflows. You can perform CRUD operations, enabling dynamic data management within your serverless architecture. Use it to save results from API calls, user inputs, or interim data; then read, update, or enrich this data in subsequent steps or workflows. Data Stores simplify stateful logic and cross-workflow communication, making them ideal for tracking process statuses, aggregating metrics, or serving as a simple configuration store.

Connect Data Stores#

export default defineComponent({
  props: {
    myDataStore: {
      type: "data_store",
    },
  },
  async run({ steps, $ }) {
    await this.myDataStore.set("key_here","Any serializable JSON as the value")
    return await this.myDataStore.get("key_here")
  },
})

Start for free — no credit card required

Watch a demo