Anthropic Claude 3.5 Haiku
Replicate chatAnthropic Claude 3.5 Haiku is a Replicate chat model.Input is priced at $1.00/M tokens and output at $5.00/M tokens. Capabilities include function calling, vision, prompt caching. Route Anthropic Claude 3.5 Haiku via Future AGI's Agent Command Center for unified observability, caching, and 15 routing strategies including cost-optimized fallback.
Estimate Anthropic Claude 3.5 Haiku spend
Pick a workload, fine-tune the sliders, and see the monthly bill.
Estimate uses $1.00/M input · $5.00/M output. Provider pricing changes. Production costs vary with retries, streaming overhead, and tool-call rounds.
Want this for free? Cache + route via Agent Command Center — first 100K requests and 100K cache hits free every month.
Pricing
Per-token rates, expressed in USD per 1M tokens. Verified May 12, 2026.
| Input | $1.00/M | |
| Output | $5.00/M |
Limits
- Context window
- —
- Max input
- —
- Max output
- —
- Modalities
- vision, text
Capabilities
- Function calling ✓ supported
- Parallel tool calls ✓ supported
- Vision input ✓ supported
- Audio input — not advertised
- Audio output — not advertised
- PDF input — not advertised
- Streaming ✓ supported
- Structured output ✓ supported
- Prompt caching ✓ supported
- Reasoning — not advertised
Where it's strong
- +parallel tool calls — only 21% of chat models on Future AGI advertise this
- +prompt caching — only 23% of chat models on Future AGI advertise this
Watch out for
- No major caveats flagged from public spec.
Benchmarks pending
We haven't logged public benchmark scores for Anthropic Claude 3.5 Haiku yet. Have one to contribute? Submit a source — citations help us prioritise.
Call Anthropic Claude 3.5 Haiku via Agent Command Center
One OpenAI-compatible endpoint. Routing, fallback, semantic caching, guardrails, and cost tracking come along for the ride. First 100K requests + 100K cache hits free every month.
agentcc / @agentcc/client). Per-call metadata — provider, cost, latency, cache hit, request id — is returned on x-agentcc-* response headers, so any HTTP client can read it.# Anthropic Claude 3.5 Haiku via the Agent Command Center Python SDK
# pip install agentcc
import os
from agentcc import AgentCC
client = AgentCC(
api_key=os.environ["AGENTCC_API_KEY"], # from app.futureagi.com → Settings → API Keys
base_url="https://gateway.futureagi.com/v1",
)
resp = client.chat.completions.create(
model="replicate/anthropic-claude-3-5-haiku",
messages=[{"role": "user", "content": "Hello, Anthropic Claude 3.5 Haiku!"}],
)
print(resp.choices[0].message.content)
print(f"Tokens: {resp.usage.total_tokens}")
# Per-call gateway metadata is returned on x-agentcc-* response headers.
# When you need it programmatically, use .with_raw_response to get them:
raw = client.chat.completions.with_raw_response.create(
model="replicate/anthropic-claude-3-5-haiku",
messages=[{"role": "user", "content": "Same call, but I want the headers."}],
)
print("Provider:", raw.headers.get("x-agentcc-provider"))
print("Latency:", raw.headers.get("x-agentcc-latency-ms"), "ms")
print("Cost: ", raw.headers.get("x-agentcc-cost"), "USD")
print("Cache: ", raw.headers.get("x-agentcc-cache"))AGENTCC_API_KEY with a key fromapp.futureagi.com.Gateway docs ↗Same model on other providers
anthropic-claude-3-5-haiku is also available via 1 other route. Pricing, regions, and capabilities can differ — compare before routing production traffic.
| Provider | Input / 1M | Output / 1M | Verified |
|---|---|---|---|
| DigitalOcean Gradient | $0.800/M | $4.00/M | May 12, 2026 |
Compare with similar models
Anthropic Claude 3.5 Haiku doesn't have a public Arena ELO score yet, so we group by provider only — quality-tier comparisons need a benchmark.
FAQ
How much does Anthropic Claude 3.5 Haiku cost?
Input is priced at $1.00 per 1M tokens and output at $5.00 per 1M tokens (Replicate, last verified May 12, 2026).
What is the context window of Anthropic Claude 3.5 Haiku?
Context window for Anthropic Claude 3.5 Haiku is not currently public.
Does Anthropic Claude 3.5 Haiku support function calling?
Yes — Anthropic Claude 3.5 Haiku supports function (tool) calling, including parallel tool calls.
Is Anthropic Claude 3.5 Haiku good for production?
Anthropic Claude 3.5 Haiku is well-suited for parallel tool calls — only 21% of chat models on Future AGI advertise this and prompt caching — only 23% of chat models on Future AGI advertise this.
How can I route to Anthropic Claude 3.5 Haiku with fallback?
Use Agent Command Center: a single OpenAI-compatible endpoint that supports cost-optimized routing, latency-aware retries, model fallback, and shadow traffic. Configure once, swap models without app changes.
Useful links for Anthropic Claude 3.5 Haiku
Official sources, independent benchmarks, and pricing aggregators — no random search-engine guesses.
Third-party evals — verify the marketing.
Cross-check our number against the rest of the ecosystem.