What do you want to automate
with FireCrawl and Search API?
Prompt, edit and deploy AI agents that connect to FireCrawl, Search API and 2,500+ other apps in seconds.
Trusted by 1,000,000+ developers from startups to Fortune 500 companies
Popular FireCrawl and Search API Actions#
Crawls a given URL and returns the contents of sub-pages. See the documentation
Google Images API uses /api/v1/search?engine=google_images API endpoint to scrape real-time results. See the documentation
Extract structured data from one or multiple URLs. See the documentation
Google Search API uses /api/v1/search?engine=google API endpoint to scrape real-time results. See the documentation
Obtains the status and data from a previous crawl operation. See the documentation
Connect FireCrawl#
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
firecrawl: {
type: "app",
app: "firecrawl",
}
},
async run({steps, $}) {
const data = {
"url": "https://pipedream.com",
}
return await axios($, {
method: "post",
url: `https://api.firecrawl.dev/v0/crawl`,
headers: {
Authorization: `Bearer ${this.firecrawl.$auth.api_key}`,
},
data,
})
},
})
Overview of Search API#
The Search API API allows you to create and manage a search engine for your website or application, providing robust search capabilities like full-text search, faceting, filtering, and autocomplete. Integrating this API into Pipedream workflows unleashes the potential for automating content indexing, performing complex searches based on triggers, and synchronizing search results with other apps for analytics, monitoring, or further processing.
Connect Search API#
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
search_api: {
type: "app",
app: "search_api",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://www.searchapi.io/api/v1/search`,
params: {
"q": `{{your_query}}`, //string to use as search query
engine: `{{your_engine}}`, //ex. "google"
api_key: `${this.search_api.$auth.api_key}`,
},
})
},
})
Trusted by 1,000,000+ developers from startups to Fortune 500 companies