02·Compare
Side by side, same effort tier
Pick up to four models. Every column is evaluated at the tier you choose (resolved to the nearest tier each model supports), so the comparison is what you'd actually deploy.
+ GPT-5.5+ Claude Fable 5+ Claude Opus 4.8− Claude Sonnet 5+ Gemini 3 Pro− Grok 4.1+ GLM-5.2− DeepSeek-V3.2+ Kimi K2 Thinking+ Qwen3-235B-A22B+ Llama 4 Maverick
| Metric | DeepSeek-V3.2 Medium | Grok 4.1 Medium | Claude Sonnet 5 Medium |
|---|---|---|---|
| Intelligence Index | 69.5 | 70.2 | 71.1 |
| Cost / typical task | $0.0015 | $0.057 | $0.042 |
| $/M in · out | $0.28 · $0.42 | $3 · $15 | $3 · $15 |
| Context window | 128K | 256K | 1M |
| Median speed | 60 tok/s | 90 tok/s | 80 tok/s |
| MMLU-Pro | 82.9 | 83.4 | 82.9 |
| GPQA Diamond | 76.1 | 76.6 | 77.0 |
| Humanity's Last Exam | 20.2 | 27.3 | 22.0 |
| AIME 2025 | 75.5 | 73.3 | 73.8 |
| SWE-bench Verified | 66.8 | 66.6 | 70.5 |
| LiveCodeBench | 73.3 | 73.8 | 74.2 |
| τ²-bench | 71.5 | 71.3 | 75.2 |
| IFEval | 86.7 | 88.2 | 89.6 |
Hover a benchmark name for what it measures — full plain-language guide on /benchmarks· preview data.