models.fyi

Side by side, same effort tier

Pick up to four models. Every column is evaluated at the tier you choose (resolved to the nearest tier each model supports), so the comparison is what you'd actually deploy.

MetricLlama 4 Maverick
Standard
Qwen3-235B-A22B
High
DeepSeek-V3.2
High
GLM-5.2
High
Intelligence Index52.472.575.575.8
Cost / typical task$0.0008$0.023$0.0039$0.021
$/M in · out$0.27 · $0.85$0.70 · $2.80$0.28 · $0.42$0.60 · $2.20
Context window1M128K128K200K
Median speed160 tok/s70 tok/s60 tok/s95 tok/s
MMLU-Pro80.083.085.085.6
GPQA Diamond70.081.083.081.6
Humanity's Last Exam9.018.022.025.0
AIME 202540.086.090.085.6
SWE-bench Verified44.068.072.074.7
LiveCodeBench48.076.079.078.6
τ²-bench52.074.078.079.7
IFEval82.087.088.089.5

Hover a benchmark name for what it measures — full plain-language guide on /benchmarks· preview data.