with Google Dialogflow and WebScraper.IO?
Emit new event when a page scraping job has completed. See the docs here
Creates a scraping job (scrapes a sitemap). See the docs here
Batch create entities, See REST docs and client API docs
Creates a sitemap for the selected website. See the docs here
Creates an Entity Type, See REST docs and client API docs
Google Dialogflow API empowers you to create conversational interfaces for websites, apps, and messaging platforms. Think chatbots that can engage in human-like dialogue, provide customer support, guide through sales processes, or control smart home devices with voice commands. With Pipedream's integration capabilities, you can create automated workflows that trigger actions in other apps based on Dialogflow's processed input, enabling seamless interaction across a plethora of services.
module.exports = defineComponent({
props: {
google_dialogflow: {
type: "app",
app: "google_dialogflow",
}
},
async run({steps, $}) {
// Example code from the Dialogflow Node.js library:
// https://github.com/googleapis/nodejs-dialogflow
const dialogflow = require('dialogflow')
const uuid = require('uuid')
// A unique identifier for the given session
const sessionId = uuid.v4()
const key = JSON.parse(this.google_dialogflow.$auth.key_json)
// Creates a session client from a Google service account key.
const sessionClient = new dialogflow.SessionsClient({
projectId: key.project_id,
credentials: {
client_email: key.client_email,
private_key: key.private_key,
}
})
const sessionPath = sessionClient.sessionPath(key.project_id, sessionId)
// The text query request.
const request = {
session: sessionPath,
queryInput: {
text: {
// The query to send to the dialogflow agent
text: 'hello',
// The language used by the client (en-US)
languageCode: 'en-US',
},
},
}
// Send request and log result
const responses = await sessionClient.detectIntent(request)
console.log('Detected intent')
const result = responses[0].queryResult
console.log(`Query: ${result.queryText}`)
console.log(`Response: ${result.fulfillmentText}`)
if (result.intent) {
console.log(`Intent: ${result.intent.displayName}`)
} else {
console.log(`No intent matched.`)
}
},
})
The WebScraper.IO API allows you to programmatically perform web scraping tasks, extracting structured data from websites. With the API, you can automate the gathering of web content for analysis, monitoring, and integration with other data sources. In Pipedream, you can leverage this API to build workflows that process, analyze, and act on the data you scrape without writing code for backend infrastructure.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
webscraper_io: {
type: "app",
app: "webscraper_io",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.webscraper.io/api/v1/sitemaps`,
params: {
api_token: `${this.webscraper_io.$auth.api_key}`,
},
})
},
})