with WebScraper.IO and Ahrefs?
Emit new event when a page scraping job has completed. See the docs here
Creates a scraping job (scrapes a sitemap). See the docs here
Get the backlinks for a domain or URL with details for the referring pages (e.g., anchor and page title).
Creates a sitemap for the selected website. See the docs here
Get one backlink with the highest ahrefs_rank
per referring domain for a target URL or domain (with details for the referring pages including anchor and page title).
Retrieves a list of scraping jobs for a sitemap. See the docs here
The WebScraper.IO API allows you to programmatically perform web scraping tasks, extracting structured data from websites. With the API, you can automate the gathering of web content for analysis, monitoring, and integration with other data sources. In Pipedream, you can leverage this API to build workflows that process, analyze, and act on the data you scrape without writing code for backend infrastructure.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
webscraper_io: {
type: "app",
app: "webscraper_io",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.webscraper.io/api/v1/sitemaps`,
params: {
api_token: `${this.webscraper_io.$auth.api_key}`,
},
})
},
})
Ahrefs API taps into the vast data reserves of Ahrefs, a robust SEO tool, to programmatically access insights into backlink profiles, keyword rankings, and SEO health. With Pipedream's capabilities, you can automate SEO monitoring, integrate with content management systems, trigger alerts for new or lost backlinks, or gather intelligence for keyword research—all without manual intervention. This unlocks the potential for real-time SEO strategy adjustments and the integration of SEO data into broader business processes or analytics platforms.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
ahrefs: {
type: "app",
app: "ahrefs",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://apiv2.ahrefs.com`,
params: {
output: `json`,
token: `${this.ahrefs.$auth.oauth_access_token}`,
from: `subscription_info`,
},
})
},
})