models.fyi

Side by side, same effort tier

Pick up to four models. Every column is evaluated at the tier you choose (resolved to the nearest tier each model supports), so the comparison is what you'd actually deploy.

MetricKimi K2 Thinking
Medium
Claude Opus 4.8
Medium
DeepSeek-V3.2
Medium
GPT-5.5
Medium
Intelligence Index65.775.569.576.6
Cost / typical task$0.011$0.090$0.0015$0.032
$/M in · out$0.60 · $2.50$5 · $25$0.28 · $0.42$1.25 · $10
Context window256K1M128K400K
Median speed50 tok/s55 tok/s60 tok/s140 tok/s
MMLU-Pro81.086.782.987.7
GPQA Diamond72.781.076.181.9
Humanity's Last Exam19.927.620.232.2
AIME 202566.380.075.583.4
SWE-bench Verified62.675.266.873.3
LiveCodeBench67.978.073.379.9
τ²-bench69.379.171.579.1
IFEval84.892.186.792.1

Hover a benchmark name for what it measures — full plain-language guide on /benchmarks· preview data.