Analyze Image/Video with Google Vertex AI API on New Label Created (Instant) from Tableau API

Pipedream makes it easy to connect APIs for Google Vertex AI, Tableau and 2,700+ other apps remarkably fast.

Trigger workflow on

New Label Created (Instant) from the Tableau API

Next, do this

Analyze Image/Video with the Google Vertex AI API

No credit card required

▶

Watch us build a workflow

8 min

Watch now ➜

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Developers ♥ Pipedream

Getting Started#

This integration creates a workflow with a Tableau trigger and Google Vertex AI action. When you configure and deploy the workflow, it will run on Pipedream's servers 24x7 for free.

Select this integration
Configure the New Label Created (Instant) trigger
1. Connect your Tableau account
2. Select a Site ID
Configure the Analyze Image/Video action
1. Connect your Google Vertex AI account
2. Select a Project ID
3. Configure Instructions
4. Configure URL
5. Optional- Configure Mime Type
Deploy the workflow
Send a test event to validate your setup
Turn on the trigger

Details#

This integration uses pre-built, source-available components from Pipedream's GitHub repo. These components are developed by Pipedream and the community, and verified and maintained by Pipedream.

To contribute an update to an existing component or create a new component, create a PR on GitHub. If you're new to Pipedream component development, you can start with quickstarts for trigger span and action development, and then review the component API reference.

Trigger#

New Label Created (Instant) on Tableau

Description:Emit new event when a label is created in Tableau. [See the documentation](https://help.tableau.com/current/developer/webhooks/en-us/docs/webhooks-events-payload.html)

Version:0.0.1

Key:tableau-label-created-instant

View on GitHub

Tableau Overview#

The Tableau API allows you to tap into the robust data visualization and business intelligence capabilities of Tableau. Within Pipedream, you can leverage this API to automate reporting, manage users, update data sources, and extract insights. This enables you to integrate Tableau's analytics with other services, streamlining your data workflows and ensuring your dashboards remain up-to-date with minimal manual effort.

Trigger Code#

import common from "../common/webhook.mjs";
import events from "../common/events.mjs";

export default {
  ...common,
  key: "tableau-label-created-instant",
  name: "New Label Created (Instant)",
  description: "Emit new event when a label is created in Tableau. [See the documentation](https://help.tableau.com/current/developer/webhooks/en-us/docs/webhooks-events-payload.html)",
  version: "0.0.1",
  type: "source",
  dedupe: "unique",
  methods: {
    ...common.methods,
    getWebhookName() {
      return "label-creation";
    },
    getEventName() {
      return events.LABEL_CREATED;
    },
    generateMeta(resource) {
      return {
        id: resource.resource_luid,
        summary: `New Label: ${resource.resource_luid}`,
        ts: Date.parse(resource.created_at),
      };
    },
  },
};

Trigger Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI and CLI.

Label	Prop	Type	Description
Tableau	`app`	`app`	This component uses the Tableau app.
N/A	`db`	`$.service.db`	This component uses `$.service.db` to maintain state between executions.
N/A	`http`	`$.interface.http`	This component uses `$.interface.http` to generate a unique URL when the component is first instantiated. Each request to the URL will trigger the `run()` method of the component.
Site ID	`siteId`	`string`	Select a value from the drop down menu.

Trigger Authentication#

Tableau uses OAuth authentication. When you connect your Tableau account, Pipedream will open a popup window where you can sign into Tableau and grant Pipedream permission to connect to your account. Pipedream securely stores and automatically refreshes the OAuth tokens so you can easily authenticate any Tableau API.

Pipedream requests the following authorization scopes when you connect your account:

About Tableau#

Tableau is a visual analytics platform transforming the way we use data to solve problems—empowering people and organizations to make the most of their data.

Action#

Analyze Image/Video on Google Vertex AI

Description:Examines an image or video following given instructions. Results will contain the analysis findings. [See the documentation](https://cloud.google.com/vertex-ai/docs/reference/rest/v1/projects.locations.publishers.models/generateContent)

Version:0.0.1

Key:google_vertex_ai-analyze-image-video

View on GitHub

Google Vertex AI Overview#

With the Google Vertex AI API, you can tap into a robust suite of AI tools offered by Google Cloud to build, deploy, and scale machine learning models. Whether you're processing data, training custom models, or using pre-trained ones, Vertex AI provides a unified platform for AI development. In Pipedream, you can create serverless workflows that interact with Vertex AI, allowing you to automate tasks like model training, prediction, and resource management without provisioning your own infrastructure.

Action Code#

import vertexAi from "../../google_vertex_ai.app.mjs";

export default {
  key: "google_vertex_ai-analyze-image-video",
  name: "Analyze Image/Video",
  description: "Examines an image or video following given instructions. Results will contain the analysis findings. [See the documentation](https://cloud.google.com/vertex-ai/docs/reference/rest/v1/projects.locations.publishers.models/generateContent)",
  version: "0.0.1",
  type: "action",
  props: {
    vertexAi,
    projectId: {
      propDefinition: [
        vertexAi,
        "projectId",
      ],
    },
    instructions: {
      type: "string",
      label: "Instructions",
      description: "The rules for analysis of the input image/video",
    },
    url: {
      type: "string",
      label: "URL",
      description: "The URL of the file or video to analyze. Only GCS URIs are supported. Please make sure that the path is a valid GCS path. Example: `gs://cloud-samples-data/generative-ai/image/mount_fuji.jpg`",
    },
    mimeType: {
      type: "string",
      label: "Mime Type",
      description: "The mimeType of the image or video to analyze",
      optional: true,
      default: "image/jpeg",
    },
  },
  async run({ $ }) {
    const response = await this.vertexAi.generateContent({
      $,
      projectId: this.projectId,
      model: "gemini-1.0-pro-vision",
      data: {
        contents: [
          {
            role: "user",
            parts: [
              {
                fileData: {
                  mimeType: this.mimeType,
                  fileUri: this.url,
                },
              },
              {
                text: this.instructions,
              },
            ],
          },
        ],
      },
    });
    $.export("$summary", "Successfully analyzed resource");
    return response;
  },
};

Action Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI.

Label	Prop	Type	Description
Google Vertex AI	`vertexAi`	`app`	This component uses the Google Vertex AI app.
Project ID	`projectId`	`string`	Select a value from the drop down menu.
Instructions	`instructions`	`string`	The rules for analysis of the input image/video
URL	`url`	`string`	The URL of the file or video to analyze. Only GCS URIs are supported. Please make sure that the path is a valid GCS path. Example: `gs://cloud-samples-data/generative-ai/image/mount_fuji.jpg`
Mime Type	`mimeType`	`string`	The mimeType of the image or video to analyze

Action Authentication#

Google Vertex AI uses OAuth authentication. When you connect your Google Vertex AI account, Pipedream will open a popup window where you can sign into Google Vertex AI and grant Pipedream permission to connect to your account. Pipedream securely stores and automatically refreshes the OAuth tokens so you can easily authenticate any Google Vertex AI API.

Pipedream requests the following authorization scopes when you connect your account:

emailprofilehttps://www.googleapis.com/auth/cloud-platform

About Google Vertex AI#

Vertex AI offers everything you need to build and use generative AI—from AI solutions, to Search and Conversation, to 130+ foundation models, to a unified AI platform.

More Ways to Connect Google Vertex AI + Tableau#

Other Popular Integrations#

Analyze Text Sentiment with Google Vertex AI API on New Label Created (Instant) from Tableau API

Tableau + Google Vertex AI

Try it

Analyze Text Sentiment with Google Vertex AI API on New Workbook Created (Instant) from Tableau API

Tableau + Google Vertex AI

Try it

Analyze Image/Video with Google Vertex AI API on New Workbook Created (Instant) from Tableau API

Tableau + Google Vertex AI

Try it

Classify Text with Google Vertex AI API on New Label Created (Instant) from Tableau API

Tableau + Google Vertex AI

Try it

Classify Text with Google Vertex AI API on New Workbook Created (Instant) from Tableau API

Tableau + Google Vertex AI

Try it

Popular Triggers#

New Label Created (Instant) from the Tableau API

Emit new event when a label is created in Tableau. See the documentation

Try it

New Workbook Created (Instant) from the Tableau API

Emit new event each time a new workbook is created in Tableau. See the documentation

Try it

Popular Actions#

Create Project with the Tableau API

Creates a project on the specified site. You can also create project hierarchies by creating a project under the specified parent project on the site. See the documentation

Try it

Query Projects with the Tableau API

Returns a list of projects on the specified site. See the documentation

Try it

Analyze Image/Video with the Google Vertex AI API

Examines an image or video following given instructions. Results will contain the analysis findings. See the documentation

Try it

Analyze Text Sentiment with the Google Vertex AI API

Analyzes a specified text for its underlying sentiment. See the documentation

Try it

Classify Text with the Google Vertex AI API

Groups a provided text into predefined categories. See the documentation