What do you want to automate
with Tavily and ScrapeGraphAI?
Prompt, edit and deploy AI agents that connect to Tavily, ScrapeGraphAI and 2,500+ other apps in seconds.
Trusted by 1,000,000+ developers from startups to Fortune 500 companies
Start for free — no credit card required
Watch a demo
Popular Tavily and ScrapeGraphAI Actions#
Start Local Scraper with the ScrapeGraphAI API
Extract content from HTML content using AI by providing a natural language prompt and the HTML content. See the documentation
Start Markdownify with the ScrapeGraphAI API
Convert any webpage into clean, readable Markdown format. See the documentation
Start Smart Scraper with the ScrapeGraphAI API
Extract content from a webpage using AI by providing a natural language prompt and a URL. See the documentation
Integrate the Tavily API with the ScrapeGraphAI API
Setup the Tavily API trigger to run a workflow which integrates with the ScrapeGraphAI API. Pipedream's integration platform allows you to integrate Tavily and ScrapeGraphAI remarkably fast. Free for developers.
Connect Tavily#
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
tavily: {
type: "app",
app: "tavily",
}
},
async run({steps, $}) {
const data = {
"api_key": `${this.tavily.$auth.api_key}`,
"query": "What is Pipedream?",
"include_domains": ["pipedream.com"]
}
return await axios($, {
method: "post",
url: `https://api.tavily.com/search`,
data,
})
},
})
Connect ScrapeGraphAI#
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
scrapegraphai: {
type: "app",
app: "scrapegraphai",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.scrapegraphai.com/v1/credits`,
headers: {
"sgai-apikey": `${this.scrapegraphai.$auth.api_key}`,
},
})
},
})
Start for free — no credit card required
Watch a demo
Trusted by 1,000,000+ developers from startups to Fortune 500 companies