models.fyi

Side by side, same effort tier

Pick up to four models. Every column is evaluated at the tier you choose (resolved to the nearest tier each model supports), so the comparison is what you'd actually deploy.

MetricGLM-5.2
Medium
DeepSeek-V3.2
Medium
Claude Fable 5
Medium
Kimi K2 Thinking
Medium
Intelligence Index69.969.578.065.7
Cost / typical task$0.0072$0.0015$0.19$0.011
$/M in · out$0.60 · $2.20$0.28 · $0.42$10 · $50$0.60 · $2.50
Context window200K128K1M256K
Median speed95 tok/s60 tok/s65 tok/s50 tok/s
MMLU-Pro83.482.988.781.0
GPQA Diamond74.876.182.872.7
Humanity's Last Exam22.920.234.019.9
AIME 202571.875.582.666.3
SWE-bench Verified69.366.877.162.6
LiveCodeBench72.973.380.867.9
τ²-bench73.071.581.069.3
IFEval88.286.793.184.8

Hover a benchmark name for what it measures — full plain-language guide on /benchmarks· preview data.