WebScraper.IO

Making web data extraction easy and accessible for everyone.

Integrate the WebScraper.IO API with the MySQL API

Setup the WebScraper.IO API trigger to run a workflow which integrates with the MySQL API. Pipedream's integration platform allows you to integrate WebScraper.IO and MySQL remarkably fast. Free for developers.

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Adyen logo
Appcues logo
Bandwidth logo
Checkr logo
ChartMogul logo
Dataminr logo
Gopuff logo
Gorgias logo
LinkedIn logo
Logitech logo
Replicated logo
Rudderstack logo
SAS logo
Scale AI logo
Webflow logo
Warner Bros. logo
Adyen logo
Appcues logo
Bandwidth logo
Checkr logo
ChartMogul logo
Dataminr logo
Gopuff logo
Gorgias logo
LinkedIn logo
Logitech logo
Replicated logo
Rudderstack logo
SAS logo
Scale AI logo
Webflow logo
Warner Bros. logo
Execute Raw Query with MySQL API on New Scraping Completed from WebScraper.IO API
WebScraper.IO + MySQL
 
Try it
Create Row with MySQL API on New Scraping Completed from WebScraper.IO API
WebScraper.IO + MySQL
 
Try it
Create Scraping Job with WebScraper.IO API on New Column from MySQL API
MySQL + WebScraper.IO
 
Try it
Create Scraping Job with WebScraper.IO API on New or Updated Row from MySQL API
MySQL + WebScraper.IO
 
Try it
Create Scraping Job with WebScraper.IO API on New Row (Custom Query) from MySQL API
MySQL + WebScraper.IO
 
Try it
New Scraping Completed from the WebScraper.IO API

Emit new event when a page scraping job has completed. See the docs here

 
Try it
New Column from the MySQL API

Emit new event when you add a new column to a table. See the docs here

 
Try it
New or Updated Row from the MySQL API

Emit new event when you add or modify a new row in a table. See the docs here

 
Try it
New Row from the MySQL API

Emit new event when you add a new row to a table. See the docs here

 
Try it
New Row (Custom Query) from the MySQL API

Emit new event when new rows are returned from a custom query. See the docs here

 
Try it
Create Scraping Job with the WebScraper.IO API

Creates a scraping job (scrapes a sitemap). See the docs here

 
Try it
Execute SQL Query with the MySQL API

Execute a custom MySQL query. See our docs to learn more about working with SQL in Pipedream.

 
Try it
Create Sitemap with the WebScraper.IO API

Creates a sitemap for the selected website. See the docs here

 
Try it
Create Row with the MySQL API

Adds a new row. See the docs here

 
Try it
Get Scraping Jobs with the WebScraper.IO API

Retrieves a list of scraping jobs for a sitemap. See the docs here

 
Try it

Overview of WebScraper.IO

The WebScraper.IO API allows you to programmatically perform web scraping tasks, extracting structured data from websites. With the API, you can automate the gathering of web content for analysis, monitoring, and integration with other data sources. In Pipedream, you can leverage this API to build workflows that process, analyze, and act on the data you scrape without writing code for backend infrastructure.

Connect WebScraper.IO

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
import { axios } from "@pipedream/platform"
export default defineComponent({
  props: {
    webscraper_io: {
      type: "app",
      app: "webscraper_io",
    }
  },
  async run({steps, $}) {
    return await axios($, {
      url: `https://api.webscraper.io/api/v1/sitemaps`,
      params: {
        api_token: `${this.webscraper_io.$auth.api_key}`,
      },
    })
  },
})

Overview of MySQL

The MySQL application on Pipedream enables direct interaction with your MySQL databases, allowing you to perform CRUD operations—create, read, update, delete—on your data with ease. You can leverage these capabilities to automate data synchronization, report generation, and event-based triggers that kick off workflows in other apps. With Pipedream's serverless platform, you can connect MySQL to hundreds of other services without managing infrastructure, crafting complex code, or handling authentication.

Connect MySQL

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
import mysql from '@pipedream/mysql';

export default defineComponent({
  props: {
    mysql,
  },
  async run({steps, $}) {
    // Component source code:
    // https://github.com/PipedreamHQ/pipedream/tree/master/components/mysql

    const queryObj = {
      sql: "SELECT NOW()",
      values: [], // Ignored since query does not contain placeholders
    };
    return await this.mysql.executeQuery(queryObj);
  },
});

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Adyen logo
Appcues logo
Bandwidth logo
Checkr logo
ChartMogul logo
Dataminr logo
Gopuff logo
Gorgias logo
LinkedIn logo
Logitech logo
Replicated logo
Rudderstack logo
SAS logo
Scale AI logo
Webflow logo
Warner Bros. logo
Adyen logo
Appcues logo
Bandwidth logo
Checkr logo
ChartMogul logo
Dataminr logo
Gopuff logo
Gorgias logo
LinkedIn logo
Logitech logo
Replicated logo
Rudderstack logo
SAS logo
Scale AI logo
Webflow logo
Warner Bros. logo