models.fyi

Side by side, same effort tier

Pick up to four models. Every column is evaluated at the tier you choose (resolved to the nearest tier each model supports), so the comparison is what you'd actually deploy.

MetricClaude Opus 4.7
Medium
Gemini 3.1 Pro
Medium
Grok 4.1
Medium
Intelligence Index74.572.770.2
Cost / typical task$0.090$0.040$0.057
$/M in · out$5 · $25$2 · $12$3 · $15
Context window1M1M256K
Median speed55 tok/s130 tok/s90 tok/s
MMLU-Pro85.785.483.4
GPQA Diamond80.080.176.6
Humanity's Last Exam25.829.927.3
AIME 202579.175.773.3
SWE-bench Verified74.369.366.6
LiveCodeBench77.175.673.8
τ²-bench78.273.971.3
IFEval91.190.288.2

Hover a benchmark name for what it measures — full plain-language guide on /benchmarks· preview data.