Diffbot

Never write another web scraper. Diffbot structures information from the web, so you don't have to.

Go to site
Explore
/
Apps
/
Diffbot

Diffbot API Integrations

Build and run workflows using the Diffbot API. Use 1000s of source-available triggers and actions across 2,000+ apps. Or write custom code to integrate any app or API in seconds.

Overview

The Diffbot API enables you to extract structured data from web pages automatically. It transforms the chaos of the web into usable information through web scraping and natural language processing. On Pipedream, you can use Diffbot to monitor changes on websites, extract article data, or process web pages for specific information. By tapping into Pipedream’s ability to integrate with hundreds of other services, you can create powerful workflows that automate data extraction and act on the data in real-time.

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
import { axios } from "@pipedream/platform"
export default defineComponent({
  props: {
    diffbot: {
      type: "app",
      app: "diffbot",
    }
  },
  async run({steps, $}) {
    return await axios($, {
      url: `https://api.diffbot.com/v4/account`,
      headers: {
        "Accept": `application/json`,
      },
      params: {
        token: `${this.diffbot.$auth.api_token}`,
      },
    })
  },
})

Choose an API to Connect with Diffbot API

1
-
24
of
2,000+
apps by most popular

HTTP / Webhook
HTTP / Webhook
Get a unique URL where you can send HTTP or webhook requests
Node
Node
Anything you can do with Node.js, you can do in a Pipedream workflow. This includes using most of npm's 400,000+ packages.
Python
Python
Anything you can do in Python can be done in a Pipedream Workflow. This includes using any of the 350,000+ PyPi packages available in your Python powered workflows.
OpenAI (ChatGPT)
OpenAI (ChatGPT)
OpenAI is an AI research and deployment company with the mission to ensure that artificial general intelligence benefits all of humanity. They are the makers of popular models like ChatGPT, DALL-E, and Whisper.
Salesforce (REST API)
Salesforce (REST API)
Web services API for interacting with Salesforce
HubSpot
HubSpot
HubSpot's CRM platform contains the marketing, sales, service, operations, and website-building software you need to grow your business.
Zoho CRM
Zoho CRM
Zoho CRM is an online Sales CRM software that manages your sales, marketing, and support in one CRM platform.
Stripe
Stripe
Stripe powers online and in-person payment processing and financial solutions for businesses of all sizes.
Shopify Developer App
Shopify Developer App
Shopify is a user-friendly e-commerce platform that helps small businesses build an online store and sell online through one streamlined dashboard.
WooCommerce
WooCommerce
WooCommerce is the open-source ecommerce platform for WordPress.
Snowflake
Snowflake
A data warehouse built for the cloud
MongoDB
MongoDB
MongoDB is an open source NoSQL database management program.
Supabase
Supabase
Supabase is an open source Firebase alternative.
MySQL
MySQL
MySQL is an open-source relational database management system.
PostgreSQL
PostgreSQL
PostgreSQL is a free and open-source relational database management system emphasizing extensibility and SQL compliance.
AWS
AWS
Amazon Web Services (AWS) offers reliable, scalable, and inexpensive cloud computing services.
Twilio SendGrid
Twilio SendGrid
Send marketing and transactional email through the Twilio SendGrid platform with the Email API, proprietary mail transfer agent, and infrastructure for scalable delivery.
Amazon SES
Amazon SES
Amazon SES is a cloud-based email service provider that can integrate into any application for high volume email automation
Klaviyo
Klaviyo
Email Marketing and SMS Marketing Platform
Zendesk
Zendesk
Zendesk is award-winning customer service software trusted by 200K+ customers. Make customers happy via text, mobile, phone, email, live chat, social media.
ServiceNow
ServiceNow
The smarter way to workflow
Notion
Notion
Notion is a new tool that blends your everyday work apps into one. It's the all-in-one workspace for you and your team.
Slack
Slack
Slack is a channel-based messaging platform. With Slack, people can work together more effectively, connect all their software tools and services, and find the information they need to do their best work — all within a secure, enterprise-grade environment.
Microsoft Teams
Microsoft Teams
Microsoft Teams has communities, events, chats, channels, meetings, storage, tasks, and calendars in one place.

Example Use Cases

  • Content Change Detection
    Use Diffbot to monitor a product page for changes and trigger a Pipedream workflow whenever the price or availability changes. This can be connected to a notification service like Slack or email to alert your team immediately.

  • Article Extraction and Analysis
    Extract articles from a set of URLs using Diffbot and send the extracted text to a sentiment analysis API like IBM Watson. Store the sentiment scores in a Google Sheet for easy tracking and visualization of the sentiment of news articles or blog posts over time.

  • Lead Generation Automation
    Scrape contact information from a list of company websites using Diffbot. Combine this with the Clearbit API to enrich the data and add it to a CRM like Salesforce or HubSpot, automating the lead generation process.

Extract Page with Diffbot API on New Requests from HTTP / Webhook API
HTTP / Webhook + Diffbot
 
Try it
Enhance Entity with Diffbot API on New Item in Feed from RSS API
RSS + Diffbot
 
Try it
Enhance Entity with Diffbot API on New Message (Instant) from Discord API
Discord + Diffbot
 
Try it
Enhance Entity with Diffbot API on New Message In Channels (Instant) from Slack API
Slack + Diffbot
 
Try it
Enhance Entity with Diffbot API on New Message in Channel from Discord Bot API
Discord Bot + Diffbot
 
Try it
Enhance Entity with the Diffbot API

Enrich a person or organization record with partial data input [See the documentation] (https://docs.diffbot.com/reference/enhancepost)

 
Try it
Extract Page with the Diffbot API

Automatically classify a page and extract data according to its type. See the documentation

 
Try it

Authentication

Diffbot uses API keys for authentication. When you connect your Diffbot account, Pipedream securely stores the keys so you can easily authenticate to Diffbot APIs in both code and no-code steps.

Sign in and copy your API token from your dashboard on the top right