models.fyi

Side by side, same effort tier

Pick up to four models. Every column is evaluated at the tier you choose (resolved to the nearest tier each model supports), so the comparison is what you'd actually deploy.

MetricClaude Opus 4.7
Low
Qwen3-235B-A22B
Low
DeepSeek-V3.2
Low
Llama 4 Maverick
Standard
Intelligence Index67.658.560.952.4
Cost / typical task$0.037$0.0038$0.0007$0.0008
$/M in · out$5 · $25$0.70 · $2.80$0.28 · $0.42$0.27 · $0.85
Context window1M128K128K1M
Median speed55 tok/s70 tok/s60 tok/s160 tok/s
MMLU-Pro83.578.480.380.0
GPQA Diamond71.363.364.870.0
Humanity's Last Exam23.014.117.29.0
AIME 202564.453.656.140.0
SWE-bench Verified67.956.159.444.0
LiveCodeBench70.562.765.248.0
τ²-bench70.559.462.652.0
IFEval89.283.184.082.0

Hover a benchmark name for what it measures — full plain-language guide on /benchmarks· preview data.