with Octoparse and Anchor Browser?
Creates a new profile from a session. A Profile stores cookies, local storage, and cache. See the documentation
Deletes an existing profile by its name. See the documentation
Allocates a new browser session for the user, with optional configurations for ad-blocking, captcha solving, proxy usage, and idle timeout. See the documentation
Updates the description or data of an existing profile using a session. See the documentation
The Octoparse API allows you to automate the extraction of web data without coding, making it a powerful tool for data-driven workflows. With this API, you can control your scraping tasks, retrieve extracted data, and manage your account programmatically. When combined with Pipedream's serverless execution environment, you can build custom workflows to process, store, or act upon the data fetched by Octoparse. This integration can be a cornerstone for solutions in market research, competitor analysis, price monitoring, or lead generation.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
octoparse: {
type: "app",
app: "octoparse",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://openapi.octoparse.com/taskGroup`,
headers: {
Authorization: `Bearer ${this.octoparse.$auth.oauth_access_token}`,
},
})
},
})
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
anchor_browser: {
type: "app",
app: "anchor_browser",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.anchorbrowser.io/api/profiles`,
headers: {
"anchor-api-key": `${this.anchor_browser.$auth.api_key}`,
},
})
},
})