An incredibly powerful web scraper.
Emit new event when a new batch is completed in OpenAI. See the documentation
Emit new event when a new file is created in OpenAI. See the documentation
Emit new event when a new fine-tuning job is created in OpenAI. See the documentation
Emit new event every time a run changes its status. See the documentation
Returns the data extracted by a specified run. See the documentation
The Chat API, using the gpt-3.5-turbo
or gpt-4
model. See the documentation
Retrieves the details of a specified project within the user's account. See the documentation
Summarizes text using the Chat API. See the documentation
Initiates an instance of a specified project on the Parsehub cloud. See the documentation
The ParseHub API allows you to leverage the power of web scraping directly within Pipedream. By integrating ParseHub, you can automate the collection of data from web pages, manipulate and transform it with Pipedream’s built-in code steps or pre-built actions, and connect it to hundreds of other apps. You can extract structured data from any website, run scraping jobs, retrieve results and integrate with other services for data processing, visualization, or storage.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
parsehub: {
type: "app",
app: "parsehub",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://www.parsehub.com/api/v2/projects`,
params: {
api_key: `${this.parsehub.$auth.api_key}`,
},
})
},
})
OpenAI provides a suite of powerful AI models through its API, enabling developers to integrate advanced natural language processing and generative capabilities into their applications. Here’s an overview of the services offered by OpenAI's API:
Use Python or Node.js code to make fully authenticated API requests with your OpenAI account:
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
openai: {
type: "app",
app: "openai",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.openai.com/v1/models`,
headers: {
Authorization: `Bearer ${this.openai.$auth.api_key}`,
},
})
},
})