with Nightfall.ai and Scrape-It.Cloud?
Initiate the scraping process for a specific endpoint. See the documentation here
The Nightfall.ai API excels in identifying and managing sensitive information exposed in text and file payloads. With Pipedream's serverless integration platform, you can wire Nightfall.ai into a variety of workflows to automate data protection and compliance processes. By tapping into Nightfall's machine learning capabilities, you can build workflows that scan and react to data in motion, ensuring sensitive info like credit card numbers, passwords, or Personally Identifiable Information (PII) is caught and handled securely.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
nightfall_ai: {
type: "app",
app: "nightfall_ai",
}
},
async run({steps, $}) {
const data = {
"fileSizeBytes": `123`,
}
return await axios($, {
method: "post",
url: `https://api.nightfall.ai/v3/upload`,
headers: {
Authorization: `Bearer ${this.nightfall_ai.$auth.api_key}`,
"Accept": `application/json`,
"Content-Type": `application/json`,
},
data,
})
},
})
The Scrape-It.Cloud API allows you to automate the extraction of data from websites. It can parse, scrape, and retrieve content without the need for manual intervention. With this API on Pipedream, you can build workflows that trigger on various events and use the scraped data for numerous applications like data analysis, lead generation, and content aggregation.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
scrape_it_cloud: {
type: "app",
app: "scrape_it_cloud",
}
},
async run({steps, $}) {
const data = {
"url": `https://pipedream.com`,
}
return await axios($, {
method: "post",
url: `https://api.scrape-it.cloud/scrape`,
headers: {
"Content-Type": `application/json`,
"x-api-key": `${this.scrape_it_cloud.$auth.api_key}`,
},
data,
})
},
})