OpenAI (ChatGPT) ACTION
Analyze Image Content
Send a message or question about an image and receive a response. See the documentation
- Action
- Writes data
- API key
- SDK
- MCP
IMPLEMENTATION
Call this tool
Connect a user's OpenAI (ChatGPT) account once, then configure and run Analyze Image Content from your backend or agent.
import { PipedreamClient } from "@pipedream/sdk"
const pd = new PipedreamClient({
projectId: process.env.PIPEDREAM_PROJECT_ID!,
clientId: process.env.PIPEDREAM_CLIENT_ID!,
clientSecret: process.env.PIPEDREAM_CLIENT_SECRET!,
projectEnvironment: "production",
})
const result = await pd.actions.run({
id: "openai-analyze-image-content",
externalUserId: "{external_user_id}", // any stable ID for this user in your system
configuredProps: {
openai: { authProvisionId: "apn_xxxxxxx" },
modelId: "Model",
message: "Message",
},
})
console.log(result)curl -X POST https://api.pipedream.com/v1/connect/{project_id}/actions/run \
-H "Content-Type: application/json" \
-H "X-PD-Environment: production" \
-H "Authorization: Bearer {access_token}" \
-d '{
"external_user_id": "{external_user_id}",
"id": "openai-analyze-image-content",
"configured_props": {
"openai": { "authProvisionId": "apn_xxxxxxx" },
"modelId": "Model",
"message": "Message"
}
}'// accessToken: mint a short-lived token with the Connect SDK — see the MCP guide
const transport = new StreamableHTTPClientTransport(
new URL("https://remote.mcp.pipedream.net/v3"),
{
requestInit: {
headers: {
Authorization: `Bearer ${accessToken}`,
"x-pd-project-id": "{project_id}",
"x-pd-environment": "production",
"x-pd-external-user-id": "{external_user_id}", // any stable ID for this user in your system
"x-pd-app-slug": "openai",
},
},
},
)
const mcp = new Client({ name: "my-agent", version: "1.0.0" })
await mcp.connect(transport)
const { tools } = await mcp.listTools()
// listTools() hands your model this tool's input schema, so it can
// fill the arguments itself:
const result = await mcp.callTool({
name: "openai-analyze-image-content",
arguments: {
modelId: "Model",
message: "Message",
},
})SCHEMA
Inputs
Pipedream supplies the connected account. Your application provides the operation-specific values below. Dynamic inputs are resolved against that user's account.
| Property | Type | Description |
|---|---|---|
modelId Model | string | The ID of the vision-capable model to use with the Responses API (e.g. gpt-4o, gpt-4.1, gpt-4.1-mini, gpt-5) Required Dynamic |
message Message | string | The message or question to send Required |
imageFileId File ID | string | The ID of the file to use for this request. Optional Dynamic |
filePath File Path | string | The image to process. Provide a path to a file in the /tmp directory (for example, /tmp/myFile.jpg). Supported image types: jpeg, jpg, png, gif, webp Optional |
fileUrl File URL | string | The image to process. Provide a URL to a file (for example, https://example.com/myFile.jpg). Supported image types: jpeg, jpg, png, gif, webp Optional |
imageDetailLevel Image Detail Level | string | The detail parameter tells the model what level of detail to use when processing and understanding the image (low, high, original, or auto). If you skip the parameter, the model will use auto. Optional |
syncDir SyncDir | dir | Optional |
REFERENCE
Tool details
Behavior hints are published with the component in the Pipedream registry and surface as MCP tool annotations, so an agent can reason about a tool before it calls it.
- Registry key
- openai-analyze-image-content
- Version
- 1.2.0
- App
- OpenAI (ChatGPT)
- Authentication
- API key
- Read-only
- No
- Destructive
- No
- Open world
- Yes
- Source
- View on GitHub ↗