models.fyi

Side by side, same effort tier

Pick up to four models. Every column is evaluated at the tier you choose (resolved to the nearest tier each model supports), so the comparison is what you'd actually deploy.

MetricDeepSeek-V3.2
Low
GPT-5.5
Minimal
Claude Opus 4.8
Low
Kimi K2 Thinking
Low
Intelligence Index60.962.468.654.1
Cost / typical task$0.0007$0.0072$0.037$0.0043
$/M in · out$0.28 · $0.42$1.25 · $10$5 · $25$0.60 · $2.50
Context window128K400K1M256K
Median speed60 tok/s140 tok/s55 tok/s50 tok/s
MMLU-Pro80.382.884.576.8
GPQA Diamond64.864.172.257.2
Humanity's Last Exam17.225.224.615.6
AIME 202556.153.465.142.6
SWE-bench Verified59.460.868.852.4
LiveCodeBench65.266.371.456.9
τ²-bench62.663.671.456.1
IFEval84.088.390.281.3

Hover a benchmark name for what it measures — full plain-language guide on /benchmarks· preview data.