with OpenGraph.io and Data Stores?
Scrape OpenGraph data from a list of URLs at once, to process multiple websites simultaneously. See the docs here
Add or update a single record in your Pipedream Data Store
Extract specific OpenGraph properties from a specified URL, such as title, image, or description. See the docs here
Add or update multiple records to your Pipedream Data Store
Retrieve OpenGraph data from a specified URL using the OpenGraph.io API. See the docs here
The OpenGraph.io API enables you to fetch Open Graph data from websites, which is useful for previewing content like images, titles, and descriptions the way social platforms do. Integrating OpenGraph.io with Pipedream allows you to automate the retrieval of this data in response to various triggers and to use it in workflows that involve other apps and services.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
opengraph_io: {
type: "app",
app: "opengraph_io",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://opengraph.io/api/1.1/site/https%3A%2F%2Fpipedream.com`,
params: {
app_id: `${this.opengraph_io.$auth.api_key}`,
},
})
},
})
Data Stores are a key-value store that allow you to persist state and share data across workflows. You can perform CRUD operations, enabling dynamic data management within your serverless architecture. Use it to save results from API calls, user inputs, or interim data; then read, update, or enrich this data in subsequent steps or workflows. Data Stores simplify stateful logic and cross-workflow communication, making them ideal for tracking process statuses, aggregating metrics, or serving as a simple configuration store.
export default defineComponent({
props: {
myDataStore: {
type: "data_store",
},
},
async run({ steps, $ }) {
await this.myDataStore.set("key_here","Any serializable JSON as the value")
return await this.myDataStore.get("key_here")
},
})