Multimodal Tool

The Image Analysis Tool

Analyze an image to describe its content, read its text, and answer questions about it so an agent can reason over photos, screenshots, and diagrams — with vision that can run in your perimeter.

Explore VDF AI Agents
Any modalityText, speech, image, video
GovernedProcessed in your perimeter
AssignableTo any VDF AI agent
100%On-premise capable
The Locked-Media Problem

Most of your content isn’t text

Calls, recordings, scans, images, and foreign-language documents carry critical information that text-only agents simply can’t use. Turning that media into data usually means shipping sensitive content to a hosted API — exactly what regulated teams can’t do.

01

Media is opaque

Audio, video, and images are invisible to search and to agents.

02

Language barriers

Content in other languages stays out of reach.

03

Manual transcription

Transcribing and translating by hand is slow and costly.

04

Sensitive content

Calls and scans can’t be sent to a third-party service.

How the Tool Works

Image Analysis, without the risk

Capability

What it does

Understand what’s in an image.

it analyzes an image to describe content, read text, and answer questions about it.

Tool
Image Analysis

Assignable to any agent

VisionDescribeRead textOn-prem

How it works

Predictable, inspectable behavior

Designed to be reliable.

analysis can run on a vision model inside your perimeter, so an agent understands images — including sensitive ones — without sending them to a hosted API.

Governed
Policy + Audit

Every call logged

ScopedLoggedGovernedOn-prem

Governance

Private, governed, on-premise

Runs inside your perimeter.

Transcription, translation, and analysis can run on local models inside your perimeter with audit logging, so sensitive audio, video, and documents become usable data without ever leaving your environment.

100%
On-Prem

Per-tenant, logged

On-premRBACAudit logSovereign
Inputs

Parameters

The image_analyze tool accepts these inputs when an agent calls it. Required inputs are flagged.

Name Type Required Description
image_base64 string Optional Base64-encoded image.
image_url string Optional URL of the image (alternative to base64).
prompt string Optional Optional question to answer about the image.
In depth

How the Image Analysis tool works in practice

Image Analysis is a multimodal tool you assign to a VDF AI agent. It analyzes an image to describe content, read text, and answer questions about it. Its hallmarks — Vision, Describe, Read text — let an agent rely on it as a dependable step in a larger task rather than a brittle one-off script.

Under the hood, analysis can run on a vision model inside your perimeter, so an agent understands images — including sensitive ones — without sending them to a hosted API. Every call is scoped to the requesting tenant and written to an audit log, so the capability is safe to run inside a regulated, on-premise environment — the same governance model behind every VDF AI tool.

Teams reach for Image Analysis when they need to handle screenshots, documents, and inspection. It rarely works alone — pair it with Video Analysis, OCR Text Extraction, and Screenshot Capture to build a complete, governed workflow, then compose those steps into an on-premise VDF AI Network.

Where it pays back

Where Image Analysis pays back

Screenshots

Understand a UI screenshot to act on it.

Documents

Read and interpret a scanned page or chart.

Inspection

Describe or classify a photo.

Accessibility

Generate alt text for images.

How VDF AI connects it

Assigned to agents, orchestrated as networks

On VDF AI, an industry’s use cases map to agents, and you assign tools like this one to those agents. Compose multiple agents into a governed, on-premise network.

ROI Snapshot

What changes after you assign it

Unlocked
Media becomes searchable data
At-scale
Hours of media processed fast
Private
Sensitive media never leaves
100%
Runs on infrastructure you control
FAQ

Questions about the Image Analysis tool

What is the Image Analysis tool?

It analyzes an image to describe content, read text, and answer questions about it. Assigned to a VDF AI agent, it runs under role-based policy with full audit logging so the capability is safe to use in production.

Can it read text in the image?

Yes. It reads embedded text and can answer questions about the image content.

How is this different from OCR?

OCR extracts text; image analysis also describes, classifies, and reasons about the whole image.

What inputs does the Image Analysis tool need?

It has no strictly required inputs, and optionally accepts image_base64, image_url, and prompt. Each parameter is validated when an agent calls the tool, and the full call is logged for audit.

Which tools pair well with Image Analysis?

Image Analysis is commonly assigned alongside Video Analysis, OCR Text Extraction, and Screenshot Capture. On VDF AI you compose several tools and agents into a single governed, on-premise network.

Does it run on-premise?

Yes. Like every VDF AI tool, it can run on-premise or in your sovereign cloud, scoped per user and audit-logged, so your data never leaves your perimeter.

How do agents use it?

You assign the tool to an agent under a role-based policy; the agent calls it as one step in a task, and several agents and tools can be orchestrated together as a governed VDF AI Network.

Put Image Analysis to work

See the Image Analysis tool assigned to an agent and orchestrated in a governed, on-premise network.