models.fyi

Side by side, same effort tier

Pick up to four models. Every column is evaluated at the tier you choose (resolved to the nearest tier each model supports), so the comparison is what you'd actually deploy.

MetricQwen3-235B-A22B
Low
Llama 4 Maverick
Standard
DeepSeek-V3.2
Low
Claude Fable 5
Low
Intelligence Index58.552.460.970.7
Cost / typical task$0.0038$0.0008$0.0007$0.080
$/M in · out$0.70 · $2.80$0.27 · $0.85$0.28 · $0.42$10 · $50
Context window128K1M128K1M
Median speed70 tok/s160 tok/s60 tok/s65 tok/s
MMLU-Pro78.480.080.386.4
GPQA Diamond63.370.064.873.8
Humanity's Last Exam14.19.017.230.3
AIME 202553.640.056.167.2
SWE-bench Verified56.144.059.470.5
LiveCodeBench62.748.065.274.0
τ²-bench59.452.062.673.0
IFEval83.182.084.091.2

Hover a benchmark name for what it measures — full plain-language guide on /benchmarks· preview data.