Togethercomputer Codellama 34B Instruct

Together AI chat

Togethercomputer Codellama 34B Instruct is a Together AI chat model. Capabilities include function calling. Route Togethercomputer Codellama 34B Instruct via Future AGI's Agent Command Center for unified observability, caching, and 15 routing strategies including cost-optimized fallback.

Pricing source: unknown Last verified: May 12, 2026 View source ↗
Pricing not yet public

We don't have verified per-token pricing for Togethercomputer Codellama 34B Instruct yet. If you have a source from Together AI's documentation, help us add it — your submission gets reviewed within 48 hours.

Pricing

Per-token rates, expressed in USD per 1M tokens. Verified May 12, 2026.

Input
Output

Limits

Context window
Max input
Max output
Modalities
text

Capabilities

  • Function calling ✓ supported
  • Parallel tool calls ✓ supported
  • Vision input — not advertised
  • Audio input — not advertised
  • Audio output — not advertised
  • PDF input — not advertised
  • Streaming ✓ supported
  • Structured output — not advertised
  • Prompt caching — not advertised
  • Reasoning — not advertised

Where it's strong

  • +parallel tool calls — only 21% of chat models on Future AGI advertise this

Watch out for

  • !strict structured output — no JSON-schema enforcement, expect retry loops

Benchmarks pending

We haven't logged public benchmark scores for Togethercomputer Codellama 34B Instruct yet. Have one to contribute? Submit a source — citations help us prioritise.

Try it

Call Togethercomputer Codellama 34B Instruct via Agent Command Center

One OpenAI-compatible endpoint. Routing, fallback, semantic caching, guardrails, and cost tracking come along for the ride. First 100K requests + 100K cache hits free every month.

SDK
Native Future AGI client (agentcc / @agentcc/client). Per-call metadata — provider, cost, latency, cache hit, request id — is returned on x-agentcc-* response headers, so any HTTP client can read it.
# Togethercomputer Codellama 34B Instruct via the Agent Command Center Python SDK
# pip install agentcc
import os
from agentcc import AgentCC

client = AgentCC(
    api_key=os.environ["AGENTCC_API_KEY"],   # from app.futureagi.com → Settings → API Keys
    base_url="https://gateway.futureagi.com/v1",
)

resp = client.chat.completions.create(
    model="together-ai/togethercomputer-codellama-34b-instruct",
    messages=[{"role": "user", "content": "Hello, Togethercomputer Codellama 34B Instruct!"}],
)

print(resp.choices[0].message.content)
print(f"Tokens: {resp.usage.total_tokens}")

# Per-call gateway metadata is returned on x-agentcc-* response headers.
# When you need it programmatically, use .with_raw_response to get them:
raw = client.chat.completions.with_raw_response.create(
    model="together-ai/togethercomputer-codellama-34b-instruct",
    messages=[{"role": "user", "content": "Same call, but I want the headers."}],
)
print("Provider:", raw.headers.get("x-agentcc-provider"))
print("Latency:", raw.headers.get("x-agentcc-latency-ms"), "ms")
print("Cost:   ", raw.headers.get("x-agentcc-cost"), "USD")
print("Cache:  ", raw.headers.get("x-agentcc-cache"))
Set AGENTCC_API_KEY with a key fromapp.futureagi.com.Gateway docs ↗

Compare with similar models

Togethercomputer Codellama 34B Instruct doesn't have a public Arena ELO score yet, so we group by provider only — quality-tier comparisons need a benchmark.

FAQ

How much does Togethercomputer Codellama 34B Instruct cost?

Public per-token pricing for Togethercomputer Codellama 34B Instruct is not yet published. Submit a source on this page to help us add it.

What is the context window of Togethercomputer Codellama 34B Instruct?

Context window for Togethercomputer Codellama 34B Instruct is not currently public.

Does Togethercomputer Codellama 34B Instruct support function calling?

Yes — Togethercomputer Codellama 34B Instruct supports function (tool) calling, including parallel tool calls.

Is Togethercomputer Codellama 34B Instruct good for production?

Togethercomputer Codellama 34B Instruct is well-suited for parallel tool calls — only 21% of chat models on Future AGI advertise this. Consider alternatives if you need strict structured output — no JSON-schema enforcement, expect retry loops.

How can I route to Togethercomputer Codellama 34B Instruct with fallback?

Use Agent Command Center: a single OpenAI-compatible endpoint that supports cost-optimized routing, latency-aware retries, model fallback, and shadow traffic. Configure once, swap models without app changes.

Useful links for Togethercomputer Codellama 34B Instruct

Official sources, independent benchmarks, and pricing aggregators — no random search-engine guesses.