Gemini 3.1 Pro preview vs GPT-5 (2025-08-07)

Gemini 3.1 Pro preview vs GPT-5 (2025-08-07): GPT-5 (2025-08-07) is cheaper by 38% on average. Gemini 3.1 Pro preview from Google Vertex AI (1,048,576-token context, reasoning, tool calls) vs. GPT-5 (2025-08-07) from Azure OpenAI (272,000-token context, reasoning, tool calls). Use Agent Command Center to A/B both in shadow mode and pick the winner per workload.

Side-by-side cost

Live workload comparison

Same workload run through both models. The cheaper one is highlighted.

3,000
01,048,576
400
0128,000
5,000
01,000,000
Google Vertex AI
$1,644/mo
Input $2.00/M · Output $12.00/M
Azure OpenAI
$1,179/mo
Input $1.25/M · Output $10.00/M
At this workload, GPT-5 (2025-08-07) is 28% cheaper than Gemini 3.1 Pro preview — a savings of $464/month ($5,570/year).
Production recipe — Agent Command Center
strategy: cost-optimized
primary:
  model: gpt-5-2025-08-07
  provider: azure-openai
fallback:
  model: gemini-3-1-pro-preview
  provider: vertex-ai
shadow: { sample_rate: 0.05 }   # mirror 5% of traffic to compare quality live
Gemini 3.1 Pro preview GPT-5 (2025-08-07)
Input price $2.00/M $1.25/M
Output price $12.00/M $10.00/M
Context window 1,048,576 272,000
Max output 65,536 128,000
Function calling
Vision
Audio input
Reasoning
Prompt caching
Structured output
Pricing verified May 12, 2026 May 12, 2026
Cheaper option
~38% cheaper than Gemini 3.1 Pro preview
Larger context
1,048,576 tokens
More capabilities
6 of 6 capability flags advertised

Benchmark comparison

Side-by-side public benchmark scores. Greener bar = winner.

Chatbot Arena ELOgeneral
Gemini 3.1 Pro preview
1,492
GPT-5 (2025-08-07)
1,450
MATH-500math
Gemini 3.1 Pro preview
GPT-5 (2025-08-07)
99.6%
AIME 2024math
Gemini 3.1 Pro preview
GPT-5 (2025-08-07)
98.4%
BFCL v3agent
Gemini 3.1 Pro preview
GPT-5 (2025-08-07)
96.3%
HumanEvalcode
Gemini 3.1 Pro preview
GPT-5 (2025-08-07)
96.0%
IFEvalgeneral
Gemini 3.1 Pro preview
GPT-5 (2025-08-07)
95.6%
AIME 2025math
Gemini 3.1 Pro preview
GPT-5 (2025-08-07)
94.6%
GPQA Diamondreasoning⚠ different settings
Gemini 3.1 Pro preview
94.3%
GPT-5 (2025-08-07)
87.3%
LiveCodeBenchcode
Gemini 3.1 Pro preview
GPT-5 (2025-08-07)
90.0%
MMLU-Proreasoning
Gemini 3.1 Pro preview
GPT-5 (2025-08-07)
89.4%
Aider Polyglotcode
Gemini 3.1 Pro preview
GPT-5 (2025-08-07)
88.0%
MMMUmultimodal
Gemini 3.1 Pro preview
GPT-5 (2025-08-07)
84.2%
SWE-bench Verifiedagent⚠ different settings
Gemini 3.1 Pro preview
80.6%
GPT-5 (2025-08-07)
74.9%
MMMU-Promultimodal
Gemini 3.1 Pro preview
80.5%
GPT-5 (2025-08-07)
ARC-AGI-2reasoning⚠ different settings
Gemini 3.1 Pro preview
77.1%
GPT-5 (2025-08-07)
17.6%
SciCodecode
Gemini 3.1 Pro preview
59.0%
GPT-5 (2025-08-07)
Humanity's Last Examreasoning⚠ different settings
Gemini 3.1 Pro preview
44.4%
GPT-5 (2025-08-07)
42.0%