Never write another web scraper. Diffbot structures information from the web, so you don't have to.
Emit new event when you add or modify a new row in a table. See the docs here
Emit new event when new rows are returned from a custom query. See the docs here
Emit new event when a new table is added to a database. See the docs here
Enrich a person or organization record with partial data input [See the documentation] (https://docs.diffbot.com/reference/enhancepost)
Automatically classify a page and extract data according to its type. See the documentation
The Diffbot API enables you to extract structured data from web pages automatically. It transforms the chaos of the web into usable information through web scraping and natural language processing. On Pipedream, you can use Diffbot to monitor changes on websites, extract article data, or process web pages for specific information. By tapping into Pipedream’s ability to integrate with hundreds of other services, you can create powerful workflows that automate data extraction and act on the data in real-time.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
diffbot: {
type: "app",
app: "diffbot",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.diffbot.com/v4/account`,
headers: {
"Accept": `application/json`,
},
params: {
token: `${this.diffbot.$auth.api_token}`,
},
})
},
})
The MySQL application on Pipedream enables direct interaction with your MySQL databases, allowing you to perform CRUD operations—create, read, update, delete—on your data with ease. You can leverage these capabilities to automate data synchronization, report generation, and event-based triggers that kick off workflows in other apps. With Pipedream's serverless platform, you can connect MySQL to hundreds of other services without managing infrastructure, crafting complex code, or handling authentication.
import mysql from '@pipedream/mysql';
export default defineComponent({
props: {
mysql,
},
async run({steps, $}) {
// Component source code:
// https://github.com/PipedreamHQ/pipedream/tree/master/components/mysql
const queryObj = {
sql: "SELECT NOW()",
values: [], // Ignored since query does not contain placeholders
};
return await this.mysql.executeQuery(queryObj);
},
});