OpenAI (ChatGPT)
OpenAI is an AI research and deployment company with the mission to ensure that artificial general intelligence benefits all of humanity. They are the makers of popular models like ChatGPT, DALL-E, and Whisper.
Integrate the OpenAI (ChatGPT) API with the WebScraper.IO API
Setup the OpenAI (ChatGPT) API trigger to run a workflow which integrates with the WebScraper.IO API. Pipedream's integration platform allows you to integrate OpenAI (ChatGPT) and WebScraper.IO remarkably fast. Free for developers.
Popular Ways to Connect OpenAI (ChatGPT) with WebScraper.IO#
Popular OpenAI (ChatGPT) and WebScraper.IO Triggers#
Emit new event when a page scraping job has completed. See the docs here
Emit new event when a new batch is completed in OpenAI. See the documentation
Emit new event when a new file is created in OpenAI. See the documentation
Emit new event when a new fine-tuning job is created in OpenAI. See the documentation
Emit new event every time a run changes its status. See the documentation
Popular OpenAI (ChatGPT) and WebScraper.IO Actions#
The Chat API, using the gpt-3.5-turbo or gpt-4 model. See the documentation
Creates a scraping job (scrapes a sitemap). See the docs here
Summarizes text using the Chat API. See the documentation
Creates a sitemap for the selected website. See the docs here
Classify items into specific categories using the Chat API. See the documentation
Overview of OpenAI (ChatGPT)#
OpenAI provides a suite of powerful AI models through its API, enabling developers to integrate advanced natural language processing and generative capabilities into their applications. Here’s an overview of the services offered by OpenAI's API:
Use Python or Node.js code to make fully authenticated API requests with your OpenAI account:
Connect OpenAI (ChatGPT)#
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
openai: {
type: "app",
app: "openai",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.openai.com/v1/models`,
headers: {
Authorization: `Bearer ${this.openai.$auth.api_key}`,
},
})
},
})
Overview of WebScraper.IO#
The WebScraper.IO API allows you to programmatically perform web scraping tasks, extracting structured data from websites. With the API, you can automate the gathering of web content for analysis, monitoring, and integration with other data sources. In Pipedream, you can leverage this API to build workflows that process, analyze, and act on the data you scrape without writing code for backend infrastructure.
Connect WebScraper.IO#
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
webscraper_io: {
type: "app",
app: "webscraper_io",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.webscraper.io/api/v1/sitemaps`,
params: {
api_token: `${this.webscraper_io.$auth.api_key}`,
},
})
},
})