models.fyi

Side by side, same effort tier

Pick up to four models. Every column is evaluated at the tier you choose (resolved to the nearest tier each model supports), so the comparison is what you'd actually deploy.

MetricGPT-5.5
Medium
Llama 4 Maverick
Standard
Kimi K2 Thinking
Medium
DeepSeek-V3.2
Medium
Intelligence Index76.652.465.769.5
Cost / typical task$0.032$0.0008$0.011$0.0015
$/M in · out$1.25 · $10$0.27 · $0.85$0.60 · $2.50$0.28 · $0.42
Context window400K1M256K128K
Median speed140 tok/s160 tok/s50 tok/s60 tok/s
MMLU-Pro87.780.081.082.9
GPQA Diamond81.970.072.776.1
Humanity's Last Exam32.29.019.920.2
AIME 202583.440.066.375.5
SWE-bench Verified73.344.062.666.8
LiveCodeBench79.948.067.973.3
τ²-bench79.152.069.371.5
IFEval92.182.084.886.7

Hover a benchmark name for what it measures — full plain-language guide on /benchmarks· preview data.