models.fyi

Side by side, same effort tier

Pick up to four models. Every column is evaluated at the tier you choose (resolved to the nearest tier each model supports), so the comparison is what you'd actually deploy.

MetricClaude Opus 4.8
Medium
DeepSeek-V3.2
Medium
Gemini 3 Pro
Medium
GPT-5.5
Medium
Intelligence Index75.569.572.776.6
Cost / typical task$0.090$0.0015$0.040$0.032
$/M in · out$5 · $25$0.28 · $0.42$2 · $12$1.25 · $10
Context window1M128K1M400K
Median speed55 tok/s60 tok/s130 tok/s140 tok/s
MMLU-Pro86.782.985.487.7
GPQA Diamond81.076.180.181.9
Humanity's Last Exam27.620.229.932.2
AIME 202580.075.575.783.4
SWE-bench Verified75.266.869.373.3
LiveCodeBench78.073.375.679.9
τ²-bench79.171.573.979.1
IFEval92.186.790.292.1

Hover a benchmark name for what it measures — full plain-language guide on /benchmarks· preview data.