with Google Search Console and MongoDB?
Fetches search analytics from Google Search Console for a verified site.
Create a new document in a collection of your choice. See the docs here
Sends a URL update notification to the Google Indexing API
Execute an aggregation pipeline on a MongoDB collection. See the documentation
The Google Search Console API opens a treasure trove of data and insights about your website's presence in Google Search results. You can get detailed reports on your site's search traffic, manage and test your site's sitemaps and robots.txt files, and see which queries bring users to your site. On Pipedream, utilize this API to automate checks on site performance, integrate with other tools for deeper analysis, or keep tabs on your SEO strategy's effectiveness.
Google Search Console distinguishes between URL properties and Domain properties:
https://example.com
or https://www.example.com
)sc-domain:example.com
)When working with subdomains:
sc-domain:example.com
)https://mcp.example.com
)https://mcp.example.com/app/slack
This approach ensures you can access subdomain data even if the subdomain isn't individually verified in Search Console.
To see data broken down by individual pages (rather than just aggregate data):
For advanced filtering needs, you can also:
SEO Performance Report to Slack: Automate daily or weekly SEO performance reports. Use the Google Search Console API to fetch search analytics data, then send a summary report to a Slack channel, keeping the team informed about trends, keyword rankings, and click-through rates.
Sync Search Results with Google Sheets: Create a workflow that periodically pulls data from the Google Search Console API and adds it to a Google Sheet. This is useful for maintaining an evolving dataset for deeper analysis, historical reference, or sharing insights across teams without giving direct access to the Search Console.
Automatic Sitemap Submission: Set up a Pipedream workflow that triggers whenever a new sitemap is generated in your content management system (CMS). The workflow can then automatically submit the sitemap to Google Search Console via API, ensuring Google has the latest structure of your site for crawling and indexing.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
google_search_console: {
type: "app",
app: "google_search_console",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://www.googleapis.com/webmasters/v3/sites`,
headers: {
Authorization: `Bearer ${this.google_search_console.$auth.oauth_access_token}`,
},
})
},
})
The MongoDB API provides powerful capabilities to interact with a MongoDB database, allowing you to perform CRUD (Create, Read, Update, Delete) operations, manage databases, and execute sophisticated queries. With Pipedream, you can harness these abilities to automate tasks, sync data across various apps, and react to events in real-time. It’s a combo that’s particularly potent for managing data workflows, syncing application states, or triggering actions based on changes to your data.
import mongodb from 'mongodb'
export default defineComponent({
props: {
mongodb: {
type: "app",
app: "mongodb",
},
collection: {
type: "string"
},
filter: {
type: "object"
}
},
async run({steps, $}) {
const MongoClient = mongodb.MongoClient
const {
database,
hostname,
username,
password,
} = this.mongodb.$auth
const url = `mongodb+srv://${username}:${password}@${hostname}/test?retryWrites=true&w=majority`
const client = await MongoClient.connect(url, {
useNewUrlParser: true,
useUnifiedTopology: true
})
const db = client.db(database)
const results = await db.collection(this.collection).find(this.filter).toArray();
$.export('results', results);
await client.close()
},
})