Octoparse

Easy Web Scraping for Anyone. No code is the best code. Octoparse allows everyone to build reliable web scrapers they need - no coding needed.

Integrate the Octoparse API with the MySQL API

Setup the Octoparse API trigger to run a workflow which integrates with the MySQL API. Pipedream's integration platform allows you to integrate Octoparse and MySQL remarkably fast. Free for developers.

New Column from the MySQL API

Emit new event when you add a new column to a table. See the docs here

 
Try it
New or Updated Row from the MySQL API

Emit new event when you add or modify a new row in a table. See the docs here

 
Try it
New Row from the MySQL API

Emit new event when you add a new row to a table. See the docs here

 
Try it
New Row (Custom Query) from the MySQL API

Emit new event when new rows are returned from a custom query. See the docs here

 
Try it
New Table from the MySQL API

Emit new event when a new table is added to a database. See the docs here

 
Try it
Create Row with the MySQL API

Adds a new row. See the docs here

 
Try it
Delete Row with the MySQL API

Delete an existing row. See the docs here

 
Try it
Execute Query with the MySQL API

Find row(s) via a custom query. See the docs here

 
Try it
Execute Raw Query with the MySQL API

Find row(s) via a custom raw query. See the documentation

 
Try it
Execute Stored Procedure with the MySQL API

Execute Stored Procedure. See the docs here

 
Try it

Overview of Octoparse

The Octoparse API allows you to automate the extraction of web data without coding, making it a powerful tool for data-driven workflows. With this API, you can control your scraping tasks, retrieve extracted data, and manage your account programmatically. When combined with Pipedream's serverless execution environment, you can build custom workflows to process, store, or act upon the data fetched by Octoparse. This integration can be a cornerstone for solutions in market research, competitor analysis, price monitoring, or lead generation.

Connect Octoparse

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
import { axios } from "@pipedream/platform"
export default defineComponent({
  props: {
    octoparse: {
      type: "app",
      app: "octoparse",
    }
  },
  async run({steps, $}) {
    return await axios($, {
      url: `https://openapi.octoparse.com/taskGroup`,
      headers: {
        Authorization: `Bearer ${this.octoparse.$auth.oauth_access_token}`,
      },
    })
  },
})

Overview of MySQL

The MySQL application on Pipedream enables direct interaction with your MySQL databases, allowing you to perform CRUD operations—create, read, update, delete—on your data with ease. You can leverage these capabilities to automate data synchronization, report generation, and event-based triggers that kick off workflows in other apps. With Pipedream's serverless platform, you can connect MySQL to hundreds of other services without managing infrastructure, crafting complex code, or handling authentication.

Connect MySQL

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
import mysql from '@pipedream/mysql';

export default defineComponent({
  props: {
    mysql,
  },
  async run({steps, $}) {
    // Component source code:
    // https://github.com/PipedreamHQ/pipedream/tree/master/components/mysql

    const queryObj = {
      sql: "SELECT NOW()",
      values: [], // Ignored since query does not contain placeholders
    };
    return await this.mysql.executeQuery(queryObj);
  },
});