Integrate the WebScraper.IO API with the MySQL API

Setup the WebScraper.IO API trigger to run a workflow which integrates with the MySQL API. Pipedream's integration platform allows you to integrate WebScraper.IO and MySQL remarkably fast. Free for developers.

Popular Ways to Connect WebScraper.IO with MySQL#

Create Row with MySQL API on New Scraping Completed from WebScraper.IO API

WebScraper.IO + MySQL

Try it

Create Scraping Job with WebScraper.IO API on New Column from MySQL API

MySQL + WebScraper.IO

Try it

Create Scraping Job with WebScraper.IO API on New or Updated Row from MySQL API

MySQL + WebScraper.IO

Try it

Create Scraping Job with WebScraper.IO API on New Row (Custom Query) from MySQL API

MySQL + WebScraper.IO

Try it

Create Scraping Job with WebScraper.IO API on New Row from MySQL API

MySQL + WebScraper.IO

Try it

Popular WebScraper.IO and MySQL Triggers#

New Scraping Completed from the WebScraper.IO API

Emit new event when a page scraping job has completed. See the docs here

Try it

New Column from the MySQL API

Emit new event when you add a new column to a table. See the docs here

Try it

New or Updated Row from the MySQL API

Emit new event when you add or modify a new row in a table. See the docs here

Try it

New Row from the MySQL API

Emit new event when you add a new row to a table. See the docs here

Try it

New Row (Custom Query) from the MySQL API

Emit new event when new rows are returned from a custom query. See the docs here

Try it

Popular WebScraper.IO and MySQL Actions#

Create Scraping Job with the WebScraper.IO API

Creates a scraping job (scrapes a sitemap). See the docs here

Try it

Create Row with the MySQL API

Adds a new row. See the docs here

Try it

Create Sitemap with the WebScraper.IO API

Creates a sitemap for the selected website. See the docs here

Try it

Delete Row with the MySQL API

Delete an existing row. See the docs here

Try it

Get Scraping Jobs with the WebScraper.IO API

Retrieves a list of scraping jobs for a sitemap. See the docs here

Try it

Overview of WebScraper.IO#

The WebScraper.IO API allows you to programmatically perform web scraping tasks, extracting structured data from websites. With the API, you can automate the gathering of web content for analysis, monitoring, and integration with other data sources. In Pipedream, you can leverage this API to build workflows that process, analyze, and act on the data you scrape without writing code for backend infrastructure.

Connect WebScraper.IO#

import { axios } from "@pipedream/platform"
export default defineComponent({
  props: {
    webscraper_io: {
      type: "app",
      app: "webscraper_io",
    }
  },
  async run({steps, $}) {
    return await axios($, {
      url: `https://api.webscraper.io/api/v1/sitemaps`,
      params: {
        api_token: `${this.webscraper_io.$auth.api_key}`,
      },
    })
  },
})

Overview of MySQL#

The MySQL application on Pipedream enables direct interaction with your MySQL databases, allowing you to perform CRUD operations—create, read, update, delete—on your data with ease. You can leverage these capabilities to automate data synchronization, report generation, and event-based triggers that kick off workflows in other apps. With Pipedream's serverless platform, you can connect MySQL to hundreds of other services without managing infrastructure, crafting complex code, or handling authentication.

Connect MySQL#

import mysql from '@pipedream/mysql';

export default defineComponent({
  props: {
    mysql,
  },
  async run({steps, $}) {
    // Component source code:
    // https://github.com/PipedreamHQ/pipedream/tree/master/components/mysql

    const queryObj = {
      sql: "SELECT NOW()",
      values: [], // Ignored since query does not contain placeholders
    };
    const { rows } = await this.mysql.executeQuery(queryObj);
    return rows;
  },
});