Start Markdownify with ScrapeGraphAI API on New Attachment Received from Gmail API

Pipedream makes it easy to connect APIs for ScrapeGraphAI, Gmail and 2,700+ other apps remarkably fast.

Trigger workflow on

New Attachment Received from the Gmail API

Next, do this

Start Markdownify with the ScrapeGraphAI API

No credit card required

▶

Watch us build a workflow

8 min

Watch now ➜

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Developers ♥ Pipedream

Getting Started#

This integration creates a workflow with a Gmail trigger and ScrapeGraphAI action. When you configure and deploy the workflow, it will run on Pipedream's servers 24x7 for free.

Select this integration
Configure the New Attachment Received trigger
1. Connect your Gmail account
2. Configure timer
3. Optional- Configure Search Query
4. Optional- Select one or more Labels
Configure the Start Markdownify action
1. Connect your ScrapeGraphAI account
2. Configure URL to Scrape
3. Optional- Configure Wait For Completion
Deploy the workflow
Send a test event to validate your setup
Turn on the trigger

Details#

This integration uses pre-built, source-available components from Pipedream's GitHub repo. These components are developed by Pipedream and the community, and verified and maintained by Pipedream.

To contribute an update to an existing component or create a new component, create a PR on GitHub. If you're new to Pipedream component development, you can start with quickstarts for trigger span and action development, and then review the component API reference.

Trigger#

New Attachment Received on Gmail

Description:Emit new event for each attachment in a message received. This source is capped at 100 max new messages per run.

Version:0.0.15

Key:gmail-new-attachment-received

View on GitHub

Gmail Overview#

By connecting your personal Gmail account to Pipedream, you'll be able to incorporate email into whatever you're building with any of the thousands of apps that are available on Pipedream.

Trigger Code#

import gmail from "../../gmail.app.mjs";
import common from "../common/polling-messages.mjs";

export default {
  ...common,
  key: "gmail-new-attachment-received",
  name: "New Attachment Received",
  description: "Emit new event for each attachment in a message received. This source is capped at 100 max new messages per run.",
  version: "0.0.15",
  type: "source",
  dedupe: "unique",
  props: {
    gmail,
    ...common.props,
    q: {
      propDefinition: [
        gmail,
        "q",
      ],
    },
    labels: {
      propDefinition: [
        gmail,
        "label",
      ],
      type: "string[]",
      label: "Labels",
      optional: true,
    },
  },
  methods: {
    ...common.methods,
    constructQuery(lastDate) {
      const hasAttachment = "has:attachment";
      if (!this.q) {
        this.q = hasAttachment;
      } else if (!this.q.includes(hasAttachment)) {
        this.q = `${this.q} ${hasAttachment}`;
      }
      return common.methods.constructQuery.call(this, lastDate);
    },
    getLabels() {
      return this.labels;
    },
    generateMeta(attachment, message) {
      return {
        id: `${message.id}${attachment.partId}`,
        summary: `New Attachment: ${attachment.filename}`,
        ts: +message.internalDate,
      };
    },
    emitEvent(message) {
      if (message) {
        const { parts: attachments } = message.payload;

        attachments.filter((attachment) => attachment.body.attachmentId).forEach((attachment) => {
          this.$emit({
            message,
            attachment,
          }, this.generateMeta(attachment, message));
        });
      }
    },
  },
};

Trigger Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI and CLI.

Label	Prop	Type	Description
Gmail	`gmail`	`app`	This component uses the Gmail app.
N/A	`db`	`$.service.db`	This component uses `$.service.db` to maintain state between executions.
	`timer`	`$.interface.timer`
Search Query	`q`	`string`	Apply a search filter using Gmail's standard search operators
Labels	`labels`	`string[]`	Select a value from the drop down menu.

Trigger Authentication#

Gmail uses OAuth authentication. When you connect your Gmail account, Pipedream will open a popup window where you can sign into Gmail and grant Pipedream permission to connect to your account. Pipedream securely stores and automatically refreshes the OAuth tokens so you can easily authenticate any Gmail API.

Pipedream requests the following authorization scopes when you connect your account:

emailprofileopenidhttps://www.googleapis.com/auth/gmail.labelshttps://www.googleapis.com/auth/gmail.sendhttps://www.googleapis.com/auth/gmail.modifyhttps://www.googleapis.com/auth/gmail.composehttps://www.googleapis.com/auth/gmail.settings.basic

About Gmail#

Gmail offers private and secure email by Google at no cost, for business and consumer accounts.

Action#

Start Markdownify on ScrapeGraphAI

Description:Convert any webpage into clean, readable Markdown format. [See the documentation](https://docs.scrapegraphai.com/api-reference/endpoint/markdownify/start)

Version:0.0.1

Key:scrapegraphai-start-markdownify

View on GitHub

Action Code#

import scrapegraphai from "../../scrapegraphai.app.mjs";

export default {
  key: "scrapegraphai-start-markdownify",
  name: "Start Markdownify",
  description: "Convert any webpage into clean, readable Markdown format. [See the documentation](https://docs.scrapegraphai.com/api-reference/endpoint/markdownify/start)",
  version: "0.0.1",
  type: "action",
  props: {
    scrapegraphai,
    url: {
      propDefinition: [
        scrapegraphai,
        "url",
      ],
      description: "The URL of the website to convert into markdown",
    },
    waitForCompletion: {
      propDefinition: [
        scrapegraphai,
        "waitForCompletion",
      ],
    },
  },
  async run({ $ }) {
    let response = await this.scrapegraphai.startMarkdownify({
      $,
      data: {
        website_url: this.url,
      },
    });

    if (this.waitForCompletion) {
      const timer = (ms) => new Promise((res) => setTimeout(res, ms));
      while (response.status !== "completed" && response.status !== "failed") {
        response = await this.scrapegraphai.getMarkdownifyStatus({
          $,
          requestId: response.request_id,
        });
        await timer(3000);
      }
    }

    if (response.status !== "failed") {
      $.export("$summary", `Successfully ${this.waitForCompletion
        ? "completed"
        : "started" } converting ${this.url} to markdown.`);
    }
    return response;
  },
};

Action Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI.

Label	Prop	Type	Description
ScrapeGraphAI	`scrapegraphai`	`app`	This component uses the ScrapeGraphAI app.
URL to Scrape	`url`	`string`	The URL of the website to convert into markdown
Wait For Completion	`waitForCompletion`	`boolean`	Set to `true` to poll the API in 3-second intervals until the request is completed

Action Authentication#

ScrapeGraphAI uses API keys for authentication. When you connect your ScrapeGraphAI account, Pipedream securely stores the keys so you can easily authenticate to ScrapeGraphAI APIs in both code and no-code steps.

About ScrapeGraphAI#

API Scraper powered by AI

More Ways to Connect ScrapeGraphAI + Gmail#

Other Popular Integrations#

Start Local Scraper with ScrapeGraphAI API on New Attachment Received from Gmail API

Gmail + ScrapeGraphAI

Start Markdownify with ScrapeGraphAI API on New Attachment Received from Gmail API

Pipedream makes it easy to connect APIs for ScrapeGraphAI, Gmail and 2,700+ other apps remarkably fast.

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Developers ♥ Pipedream

1-24of2,700+apps by most popular

1
-
24
of
2,700+
apps by most popular