Describe Image with astica.ai API on New Labeled Email from Gmail API

Pipedream makes it easy to connect APIs for astica.ai, Gmail and 2,900+ other apps remarkably fast.

Trigger workflow on

New Labeled Email from the Gmail API

Next, do this

Describe Image with the astica.ai API

No credit card required

▶

Watch us build a workflow

8 min

Watch now ➜

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Developers ♥ Pipedream

Getting Started#

This integration creates a workflow with a Gmail trigger and astica.ai action. When you configure and deploy the workflow, it will run on Pipedream's servers 24x7 for free.

Select this integration
Configure the New Labeled Email trigger
1. Connect your Gmail account
2. Configure timer
3. Select one or more Labels
4. Configure Return payload as plaintext
Configure the Describe Image action
1. Connect your astica.ai account
2. Configure Image
3. Optional- Configure Describe
4. Optional- Configure GPT
5. Optional- Configure GPT Detailed
6. Optional- Configure Faces
7. Optional- Configure Moderate
8. Optional- Configure Tags
9. Optional- Configure Brands
10. Optional- Configure Celebrities
11. Optional- Configure Landmarks
Deploy the workflow
Send a test event to validate your setup
Turn on the trigger

Details#

This integration uses pre-built, source-available components from Pipedream's GitHub repo. These components are developed by Pipedream and the community, and verified and maintained by Pipedream.

To contribute an update to an existing component or create a new component, create a PR on GitHub. If you're new to Pipedream component development, you can start with quickstarts for trigger span and action development, and then review the component API reference.

Trigger#

New Labeled Email on Gmail

Description:Emit new event when a new email is labeled.

Version:0.1.2

Key:gmail-new-labeled-email

View on GitHub

Gmail Overview#

By connecting your personal Gmail account to Pipedream, you'll be able to incorporate email into whatever you're building with any of the thousands of apps that are available on Pipedream.

Trigger Code#

import gmail from "../../gmail.app.mjs";
import common from "../common/polling-history.mjs";
import sampleEmit from "./test-event.mjs";

export default {
  ...common,
  key: "gmail-new-labeled-email",
  name: "New Labeled Email",
  description: "Emit new event when a new email is labeled.",
  type: "source",
  version: "0.1.2",
  dedupe: "unique",
  props: {
    gmail,
    ...common.props,
    labels: {
      propDefinition: [
        gmail,
        "label",
      ],
      type: "string[]",
      label: "Labels",
    },
    withTextPayload: {
      type: "boolean",
      label: "Return payload as plaintext",
      description: "Convert the payload response into a single text field. **This reduces the size of the payload and makes it easier for LLMs work with.**",
      default: false,
    },
  },
  methods: {
    ...common.methods,
    getHistoryTypes() {
      return [
        "labelAdded",
        "messageAdded",
      ];
    },
    generateMeta(message) {
      return {
        id: `${message.id}-${message.historyId}`,
        summary: `A new message with ID: ${message.id} was labeled"`,
        ts: +message.internalDate,
      };
    },
    filterHistory(history) {
      return history.filter((item) =>
        (item.labelsAdded && item.labelsAdded[0].labelIds.some((i) => this.labels.includes(i)))
        || (item.messagesAdded
          && item.messagesAdded[0].message.labelIds
          && item.messagesAdded[0].message.labelIds.some((i) => this.labels.includes(i))));
    },
  },
  sampleEmit,
};

Trigger Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI and CLI.

Label	Prop	Type	Description
Gmail	`gmail`	`app`	This component uses the Gmail app.
N/A	`db`	`$.service.db`	This component uses `$.service.db` to maintain state between executions.
	`timer`	`$.interface.timer`
Labels	`labels`	`string[]`	Select a value from the drop down menu.
Return payload as plaintext	`withTextPayload`	`boolean`	Convert the payload response into a single text field. This reduces the size of the payload and makes it easier for LLMs work with.

Trigger Authentication#

Gmail uses OAuth authentication. When you connect your Gmail account, Pipedream will open a popup window where you can sign into Gmail and grant Pipedream permission to connect to your account. Pipedream securely stores and automatically refreshes the OAuth tokens so you can easily authenticate any Gmail API.

Pipedream requests the following authorization scopes when you connect your account:

emailprofileopenidhttps://www.googleapis.com/auth/gmail.labelshttps://www.googleapis.com/auth/gmail.sendhttps://www.googleapis.com/auth/gmail.modifyhttps://www.googleapis.com/auth/gmail.composehttps://www.googleapis.com/auth/gmail.settings.basic

About Gmail#

Gmail offers private and secure email by Google at no cost, for business and consumer accounts.

Action#

Describe Image on astica.ai

Description:Analyze an image with Astica AI [See the documentation](https://astica.ai/vision/documentation/)

Version:0.0.2

Key:astica_ai-describe-image

View on GitHub

astica.ai Overview#

The Astica.ai API affords developers the ability to tap into advanced natural language processing (NLP) capabilities. By integrating this API into Pipedream workflows, you can automate text analysis, summarization, sentiment analysis, and more, leveraging the AI-powered insights to enrich applications or streamline processes. Pipedream’s serverless platform makes it painless to set up event-driven workflows that respond to various triggers and manipulate or move data between apps with no need for infrastructure management.

Action Code#

import asticaAi from "../../astica_ai.app.mjs";

export default {
  name: "Describe Image",
  description: "Analyze an image with Astica AI [See the documentation](https://astica.ai/vision/documentation/)",
  key: "astica_ai-describe-image",
  version: "0.0.2",
  annotations: {
    destructiveHint: false,
    openWorldHint: true,
    readOnlyHint: true,
  },
  type: "action",
  props: {
    asticaAi,
    image: {
      type: "string",
      label: "Image",
      description: "The URL of the image to analyze",
    },
    describe: {
      type: "boolean",
      label: "Describe",
      description: "Returns a caption which describes the image.",
      optional: true,
      default: false,
    },
    gpt: {
      type: "boolean",
      label: "GPT",
      description: "Uses the result of asticaVision to create a GPT description. Using this parameter increases the processing time of your API request. Be Patient.",
      optional: true,
      default: false,
    },
    gpt_detailed: {
      type: "boolean",
      label: "GPT Detailed",
      description: "Uses the result of asticaVision to create a GPT-4 description. Using this parameter greatly increases the processing time of your API request. Please be patient.",
      optional: true,
      default: false,
    },
    faces: {
      type: "boolean",
      label: "Faces",
      description: "Returns the age and gender of all faces detected in the image.",
      optional: true,
      default: false,
    },
    moderate: {
      type: "boolean",
      label: "Moderate",
      description: "Returns a calculated value for different types of sensitive materials found in the image.",
      optional: true,
      default: false,
    },
    tags: {
      type: "boolean",
      label: "Tags",
      description: "Returns a list of descriptive terms which describe the image.",
      optional: true,
      default: false,
    },
    brands: {
      type: "boolean",
      label: "Brands",
      description: "Returns a list of brands that have been identified. For example, a logo on a cup, or a t-shirt.",
      optional: true,
      default: false,
    },
    celebrities: {
      type: "boolean",
      label: "Celebrities",
      description: "Returns a list of celebrities and other known persons that have been detected in the photo.",
      optional: true,
      default: false,
    },
    landmarks: {
      type: "boolean",
      label: "Landmarks",
      description: "Returns a list of known locations and landmarks found in the photo. For example, the Eiffel Tower.",
      optional: true,
      default: false,
    },
  },
  async run({ $ }) {
    const {
      asticaAi,
      image,
      ...otherProps
    } = this;

    const visionParams = [];
    for (const [
      key,
      value,
    ] of Object.entries(otherProps)) {
      if (value) {
        visionParams.push(key);
      }
    }

    const response = await asticaAi.describeImage({
      data: {
        input: image,
        visionParams: visionParams.join(","),
        modelVersion: "2.1_full",
        gpt_prompt: "",
        gpt_length: "90",
      },
      $,
    });

    if (response?.status === "success") {
      $.export("$summary", "Successfully analyzed image.");
    }

    return response;
  },
};

Action Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI.

Label	Prop	Type	Description
astica.ai	`asticaAi`	`app`	This component uses the astica.ai app.
Image	`image`	`string`	The URL of the image to analyze
Describe	`describe`	`boolean`	Returns a caption which describes the image.
GPT	`gpt`	`boolean`	Uses the result of asticaVision to create a GPT description. Using this parameter increases the processing time of your API request. Be Patient.
GPT Detailed	`gpt_detailed`	`boolean`	Uses the result of asticaVision to create a GPT-4 description. Using this parameter greatly increases the processing time of your API request. Please be patient.
Faces	`faces`	`boolean`	Returns the age and gender of all faces detected in the image.
Moderate	`moderate`	`boolean`	Returns a calculated value for different types of sensitive materials found in the image.
Tags	`tags`	`boolean`	Returns a list of descriptive terms which describe the image.
Brands	`brands`	`boolean`	Returns a list of brands that have been identified. For example, a logo on a cup, or a t-shirt.
Celebrities	`celebrities`	`boolean`	Returns a list of celebrities and other known persons that have been detected in the photo.
Landmarks	`landmarks`	`boolean`	Returns a list of known locations and landmarks found in the photo. For example, the Eiffel Tower.

Action Authentication#

astica.ai uses API keys for authentication. When you connect your astica.ai account, Pipedream securely stores the keys so you can easily authenticate to astica.ai APIs in both code and no-code steps.

About astica.ai#

Integrate artificial intelligence into your applications without deploying models and no infra.

More Ways to Connect astica.ai + Gmail#

Other Popular Integrations#

Speech To Text with astica.ai API on New Labeled Email from Gmail API

Gmail + astica.ai

Describe Image with astica.ai API on New Labeled Email from Gmail API

Pipedream makes it easy to connect APIs for astica.ai, Gmail and 2,900+ other apps remarkably fast.

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Developers ♥ Pipedream

1-24of2,900+apps by most popular

1
-
24
of
2,900+
apps by most popular