What do you want to automate
with Scrapfly and Gem?
Prompt, edit and deploy AI agents that connect to Scrapfly, Gem and 2,500+ other apps in seconds.
Trusted by 1,000,000+ developers from startups to Fortune 500 companies
Start for free — no credit card required
Watch a demo
Popular Scrapfly and Gem Triggers#
New Candidate Added from the Gem API
Emit new event when a candidate is added in Gem. See the documentation
Popular Scrapfly and Gem Actions#
AI Data Extraction with the Scrapfly API
Automate content extraction from any text-based source using AI, LLM, and custom parsing. See the documentation
Retrieve Scrapfly Account Info with the Scrapfly API
Retrieve current subscription and account usage details from Scrapfly. See the documentation
Integrate the Scrapfly API with the Gem API
Setup the Scrapfly API trigger to run a workflow which integrates with the Gem API. Pipedream's integration platform allows you to integrate Scrapfly and Gem remarkably fast. Free for developers.
Connect Scrapfly#
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
scrapfly: {
type: "app",
app: "scrapfly",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.scrapfly.io/scrape`,
params: {
key: `${this.scrapfly.$auth.api_key}`,
url: `https://pipedream.com`,
render_js: `true`,
asp: `true`,
},
})
},
})
Connect Gem#
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
gem: {
type: "app",
app: "gem",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.gem.com/v0/users`,
headers: {
"x-api-key": `${this.gem.$auth.api_key}`,
"content-type": `application/json`,
},
})
},
})
Start for free — no credit card required
Watch a demo
Trusted by 1,000,000+ developers from startups to Fortune 500 companies