Gemini Pro
Google Vertex AI chatGemini Pro is a Google Vertex AI chat model.It supports a 32,760-token context windowwith up to 8,192 output tokens.Input is priced at $0.500/M tokens and output at $1.50/M tokens. Capabilities include function calling. Route Gemini Pro via Future AGI's Agent Command Center for unified observability, caching, and 15 routing strategies including cost-optimized fallback.
Estimate Gemini Pro spend
Pick a workload, fine-tune the sliders, and see the monthly bill.
Estimate uses $0.5000/M input · $1.50/M output. Provider pricing changes. Production costs vary with retries, streaming overhead, and tool-call rounds.
Want this for free? Cache + route via Agent Command Center — first 100K requests and 100K cache hits free every month.
Pricing
Per-token rates, expressed in USD per 1M tokens. Verified May 7, 2026.
| Input | $0.500/M | |
| Output | $1.50/M | |
| Blended (3:1 in:out) | $0.750/M Cross-model comparable price | |
| Per image | $0.002500 |
Context & limits
- Context window
- 32,760 tokens
- Max input
- 32,760 tokens
- Max output
- 8,192 tokens
- Modalities
- text
Capabilities
- Function calling ✓ supported
- Parallel tool calls ✓ supported
- Vision input — not advertised
- Audio input — not advertised
- Audio output — not advertised
- PDF input — not advertised
- Streaming ✓ supported
- Structured output — not advertised
- Prompt caching — not advertised
- Reasoning — not advertised
Strengths & caveats — when to pick Gemini Pro
Data-driven from Gemini Pro's percentile within chat peers.
Where it's strong
- +parallel tool calls — only 18% of chat models on Future AGI advertise this
Watch out for
- !limited context — 32,760-token window is in the bottom quartile; not ideal for long documents or large RAG
- !strict structured output — no JSON-schema enforcement, expect retry loops
Benchmark scores
Reported public benchmark numbers. Each row links to the source. Faded bar shows 6-peer average for context.
Call Gemini Pro via Agent Command Center
One OpenAI-compatible endpoint. Routing, fallback, semantic caching, guardrails, and cost tracking come along for the ride. First 100K requests + 100K cache hits free every month.
agentcc / @agentcc/client). Per-call metadata — provider, cost, latency, cache hit, request id — is returned on x-agentcc-* response headers, so any HTTP client can read it.# Gemini Pro via the Agent Command Center Python SDK
# pip install agentcc
import os
from agentcc import AgentCC
client = AgentCC(
api_key=os.environ["AGENTCC_API_KEY"], # from app.futureagi.com → Settings → API Keys
base_url="https://gateway.futureagi.com/v1",
)
resp = client.chat.completions.create(
model="vertex-ai/gemini-pro",
messages=[{"role": "user", "content": "Hello, Gemini Pro!"}],
)
print(resp.choices[0].message.content)
print(f"Tokens: {resp.usage.total_tokens}")
# Per-call gateway metadata is returned on x-agentcc-* response headers.
# When you need it programmatically, use .with_raw_response to get them:
raw = client.chat.completions.with_raw_response.create(
model="vertex-ai/gemini-pro",
messages=[{"role": "user", "content": "Same call, but I want the headers."}],
)
print("Provider:", raw.headers.get("x-agentcc-provider"))
print("Latency:", raw.headers.get("x-agentcc-latency-ms"), "ms")
print("Cost: ", raw.headers.get("x-agentcc-cost"), "USD")
print("Cache: ", raw.headers.get("x-agentcc-cache"))AGENTCC_API_KEY with a key fromapp.futureagi.com.Gateway docs ↗Advanced: fallback + cache config (YAML) ▸
strategy: cost-optimized
targets:
- model: gemini-pro
provider: vertex-ai
weight: 80
fallbacks:
- model: llama-3-3-70b-instruct
provider: azure-ai-foundry
- model: claude-3-opus-20240229
provider: anthropic
guardrails: [pii, prompt-injection, secrets]
cache: { exact: true, semantic: true } Same model on other providers
gemini-pro is also available via 1 other route. Pricing, regions, and capabilities can differ — compare before routing production traffic.
| Provider | Input / 1M | Output / 1M | Verified |
|---|---|---|---|
| Google AI | $0.350/M | $1.05/M | May 7, 2026 |
Explore similar models
Grouped by Chatbot Arena tier (Gemini Pro sits at 1224 ELO). Side-by-side links appear where a comparison page exists; otherwise, open the model profile.
- Claude Opus 4.7Google Vertex AI · $5.00/M in · $25.00/M out · 1,000,000 ctxView model →
- Claude Opus 4.6Google Vertex AI · $5.00/M in · $25.00/M out · 1,000,000 ctxView model →
- Gemini 3.1 Pro previewGoogle Vertex AI · $2.00/M in · $12.00/M out · 1,048,576 ctxView model →
- Gemini 3 Pro PreviewGoogle Vertex AI · $2.00/M in · $12.00/M out · 1,048,576 ctxView model →
- Llama 3.3 70B InstructAzure AI Foundry · $0.710/M in · $0.710/M out · 128,000 ctxView model →
- Claude 3 Opus (2024-02-29)Anthropic · $15.00/M in · $75.00/M out · 200,000 ctxView model →
- GPT-3.5 TurboAzure OpenAI · $0.500/M in · $1.50/M out · 4,097 ctxView model →
- Gemini Pro latestGoogle AI · $2.00/M in · $12.00/M out · 1,048,576 ctxView model →
≥30 ELO higher
- Gemini 4 ArgonGoogle AI · $2.00/M in · $10.00/M out · 1,048,576 ctxView model →
- Claude Opus 5.5Azure AI Foundry · $4.00/M in · $20.00/M out · 1,000,000 ctxView model →
- Claude Fable 5Azure AI Foundry · $10.00/M in · $50.00/M out · 1,000,000 ctxView model →
- Claude Fable 5.1Azure AI Foundry · $10.00/M in · $50.00/M out · 1,000,000 ctxView model →
FAQ
How much does Gemini Pro cost?
Input is priced at $0.500 per 1M tokens and output at $1.50 per 1M tokens (Google Vertex AI, last verified May 7, 2026).
What is the context window of Gemini Pro?
Gemini Pro supports a 32,760-token context window with up to 8,192 output tokens.
Does Gemini Pro support function calling?
Yes — Gemini Pro supports function (tool) calling, including parallel tool calls.
Is Gemini Pro good for production?
Gemini Pro is well-suited for parallel tool calls — only 18% of chat models on Future AGI advertise this. Consider alternatives if you need limited context — 32,760-token window is in the bottom quartile; not ideal for long documents or large RAG.
How can I route to Gemini Pro with fallback?
Use Agent Command Center: a single OpenAI-compatible endpoint that supports cost-optimized routing, latency-aware retries, model fallback, and shadow traffic. Configure once, swap models without app changes.
Useful links for Gemini Pro
Official sources, independent benchmarks, and pricing aggregators — no random search-engine guesses.
Third-party evals — verify the marketing.
Cross-check our number against the rest of the ecosystem.