CONNECT APP
Build with Google Vertex AI
Artificial Intelligence (AI)
- OAuth
MCP
Give your agent Google Vertex AI tools
Every Google Vertex AI action is exposed as an MCP tool on Pipedream's remote server. Point a client at it with your end user's ID and Connect resolves that user's Google Vertex AI account for each tool call — you store no tokens.
// accessToken: mint a short-lived token with the Connect SDK — see the MCP guide
const transport = new StreamableHTTPClientTransport(
new URL("https://remote.mcp.pipedream.net/v3"),
{
requestInit: {
headers: {
Authorization: `Bearer ${accessToken}`,
"x-pd-project-id": "{project_id}",
"x-pd-environment": "production",
"x-pd-external-user-id": "{external_user_id}", // any stable ID for this user in your system
"x-pd-app-slug": "google_vertex_ai",
},
},
},
)
const mcp = new Client({ name: "my-agent", version: "1.0.0" })
await mcp.connect(transport)
const { tools } = await mcp.listTools()
// e.g. run Analyze Image/Video:
const result = await mcp.callTool({
name: "google_vertex_ai-analyze-image-video",
arguments: {
projectId: "Project ID",
instructions: "Instructions",
},
})# access_token: mint a short-lived token with the Connect SDK — see the MCP guide
headers = {
"Authorization": f"Bearer {access_token}",
"x-pd-project-id": "{project_id}",
"x-pd-environment": "production",
"x-pd-external-user-id": "{external_user_id}", # any stable ID for this user in your system
"x-pd-app-slug": "google_vertex_ai",
}
async with streamablehttp_client("https://remote.mcp.pipedream.net/v3", headers=headers) as (read, write, _):
async with ClientSession(read, write) as session:
await session.initialize()
tools = await session.list_tools()
# e.g. run Analyze Image/Video:
result = await session.call_tool("google_vertex_ai-analyze-image-video", {
"projectId": "Project ID",
"instructions": "Instructions",
})API PROXY
Call the Google Vertex AI API directly
For an endpoint with no pre-built tool, the Connect proxy forwards your request to the Google Vertex AI API with the connected user's credentials attached. You store no tokens and write no refresh logic.
const resp = await pd.proxy.get({
externalUserId: "{external_user_id}", // any stable ID for this user in your system
accountId: "apn_xxxxxxx",
url: "https://www.googleapis.com/oauth2/v1/userinfo",
})
// Any allowed Google Vertex AI endpoint works here. Pipedream attaches the
// connected account's credentials to the outgoing request.# The path segment is the target URL, URL-safe base64 encoded:
# https://www.googleapis.com/oauth2/v1/userinfo
curl "https://api.pipedream.com/v1/connect/{project_id}/proxy/aHR0cHM6Ly93d3cuZ29vZ2xlYXBpcy5jb20vb2F1dGgyL3YxL3VzZXJpbmZv?external_user_id={external_user_id}&account_id=apn_xxxxxxx" \
-H "Authorization: Bearer {access_token}" \
-H "x-pd-environment: production"SDK
Run Google Vertex AI actions from your backend
Connect a user's Google Vertex AI account once, then run Analyze Image/Video on their behalf from your own code — TypeScript, Python, or plain HTTP.
import { PipedreamClient } from "@pipedream/sdk"
const pd = new PipedreamClient({
projectId: process.env.PIPEDREAM_PROJECT_ID!,
clientId: process.env.PIPEDREAM_CLIENT_ID!,
clientSecret: process.env.PIPEDREAM_CLIENT_SECRET!,
projectEnvironment: "production",
})
const result = await pd.actions.run({
id: "google_vertex_ai-analyze-image-video",
externalUserId: "{external_user_id}", // any stable ID for this user in your system
configuredProps: {
google_vertex_ai: { authProvisionId: "apn_xxxxxxx" },
projectId: "Project ID",
instructions: "Instructions",
},
})from pipedream import Pipedream
pd = Pipedream(
client_id="{oauth_client_id}",
client_secret="{oauth_client_secret}",
project_id="{project_id}",
project_environment="production",
)
result = pd.actions.run(
id="google_vertex_ai-analyze-image-video",
external_user_id="{external_user_id}", # any stable ID for this user in your system
configured_props={
"google_vertex_ai": {"authProvisionId": "apn_xxxxxxx"},
"projectId": "Project ID",
"instructions": "Instructions",
},
)curl -X POST https://api.pipedream.com/v1/connect/{project_id}/actions/run \
-H "Content-Type: application/json" \
-H "X-PD-Environment: production" \
-H "Authorization: Bearer {access_token}" \
-d '{
"external_user_id": "{external_user_id}",
"id": "google_vertex_ai-analyze-image-video",
"configured_props": {
"google_vertex_ai": { "authProvisionId": "apn_xxxxxxx" },
"projectId": "Project ID",
"instructions": "Instructions"
}
}'TOOLS
Google Vertex AI actions
On-demand operations your product or agent can configure and run on behalf of a connected user.
-
Analyze Image/Video
actionExamines an image or video following given instructions. Results will contain the analysis findings. See the documentationRead-onlyv0.0.3 -
Analyze Text Sentiment
actionAnalyzes a specified text for its underlying sentiment. See the documentationRead-onlyv0.0.3 -
Classify Text
actionGroups a provided text into predefined categories. See the documentationWritev0.0.3 -
Generate Video from Image
actionGenerate a video from an image with optional text prompt using Google Vertex AI Veo models. See the documentationWritev0.0.2 -
Generate Video from Text
actionGenerate a video from a text prompt using Google Vertex AI Veo models. See the documentationWritev0.0.2
EVENTS
Google Vertex AI triggers
Event sources your backend can deploy for users and receive through a webhook.
No Google Vertex AI triggers are available yet.
MULTI-APP
Use Google Vertex AI with other popular apps
Most products don't stop at one integration. Pair Google Vertex AI with the other apps your users rely on, and ship use cases that span both.
REFERENCE
App details
Reference metadata for the Google Vertex AI connector in the Pipedream registry.
- App slug
- google_vertex_ai
- Authentication
- OAuth
- Categories
- Artificial Intelligence (AI)
- Actions
- 5
- Triggers
- 0
- API proxy
- Available
OAuth scopes
These are the scopes Pipedream's managed Google Vertex AI OAuth client requests when one of your users connects an account. Supply your own OAuth client to request a different set.
- profile
- https://www.googleapis.com/auth/cloud-platform