with Google Safe Browsing and FireCrawl?
Emit new event when a threat list is updated. See the documentation
Scan a given URL or URLs for potential security threats. See the documentation
Crawls a given URL and returns the contents of sub-pages. See the documentation
Get the latest threat list update information from Google Safe Browsing API. See the documentation
Extract structured data from one or multiple URLs. See the documentation
Obtains the status and data from a previous crawl operation. See the documentation
The Google Safe Browsing API lets you check URLs against Google's constantly updated lists of unsafe web resources. These include social engineering sites (like phishing and deceptive sites) and sites that host malware or unwanted software. Within Pipedream, you can leverage this API to automate the process of scanning URLs in various contexts, such as user-generated content, emails, or within applications that require high-security measures.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
google_safebrowsing: {
type: "app",
app: "google_safebrowsing",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://safebrowsing.googleapis.com/v4/threatLists`,
params: {
key: `${this.google_safebrowsing.$auth.api_key}`,
},
})
},
})
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
firecrawl: {
type: "app",
app: "firecrawl",
}
},
async run({steps, $}) {
const data = {
"url": "https://pipedream.com",
}
return await axios($, {
method: "post",
url: `https://api.firecrawl.dev/v0/crawl`,
headers: {
Authorization: `Bearer ${this.firecrawl.$auth.api_key}`,
},
data,
})
},
})