View as Markdown
Google Vertex AI icon

Google Vertex AI ACTION

Analyze Image/Video

Examines an image or video following given instructions. Results will contain the analysis findings. See the documentation
  • Action
  • Read only
  • OAuth
  • SDK
  • MCP

IMPLEMENTATION

Call this tool

Connect a user's Google Vertex AI account once, then configure and run Analyze Image/Video from your backend or agent.

import { PipedreamClient } from "@pipedream/sdk"

const pd = new PipedreamClient({
  projectId: process.env.PIPEDREAM_PROJECT_ID!,
  clientId: process.env.PIPEDREAM_CLIENT_ID!,
  clientSecret: process.env.PIPEDREAM_CLIENT_SECRET!,
  projectEnvironment: "production",
})

const result = await pd.actions.run({
  id: "google_vertex_ai-analyze-image-video",
  externalUserId: "{external_user_id}", // any stable ID for this user in your system
  configuredProps: {
    google_vertex_ai: { authProvisionId: "apn_xxxxxxx" },
    projectId: "Project ID",
    instructions: "Instructions",
  },
})

console.log(result)

SCHEMA

Inputs

Pipedream supplies the connected account. Your application provides the operation-specific values below. Dynamic inputs are resolved against that user's account.

Analyze Image/Video inputs
Property Type Description
projectId Project ID string
Identifier of a project
Required Dynamic
instructions Instructions string
The rules for analysis of the input image/video
Required
url URL string
The URL of the file or video to analyze. Only GCS URIs are supported. Please make sure that the path is a valid GCS path. Example: gs://cloud-samples-data/generative-ai/image/mount_fuji.jpg
Required
mimeType Mime Type string
The mimeType of the image or video to analyze
Optional

REFERENCE

Tool details

Behavior hints are published with the component in the Pipedream registry and surface as MCP tool annotations, so an agent can reason about a tool before it calls it.

Registry key
google_vertex_ai-analyze-image-video
Version
0.0.3
App
Google Vertex AI
Authentication
OAuth
Read-only
Yes
Destructive
No
Open world
Yes