Coding benchmarks, as reported by publishers
Every figure below is self-reported by the model's publisher. Harnesses can differ even where a benchmark name matches, so this is not an independent or like-for-like ranking.
Price-performance field
DeepSWE v1.1 scores against a 3:1 input-output blended price. The two publisher runs may use different harnesses, so position is orientation—not a rank.
Price as published · Aug 14, 2026
Price not published
GLM-5.3Blended price = 0.75 × input price + 0.25 × output price. Hollow squares mean not in MiniRouter's catalog; GLM-5.3 remains on the unpriced rail instead of receiving an estimate.
Scroll for more columns →
| Model | Catalog | Price phase | Blended / 1M | DeepSWE v1.1 | Reported by | Source |
|---|---|---|---|---|---|---|
| Gemini 3.7 Flash | No | Introductory | $1.50 | 65.3% | Google ↗ | |
| Gemini 3.7 Flash | No | Standard | $3.00 | 65.3% | Google ↗ | |
| GLM-5.3 | No | — | Not published | 66.9% | Z.ai | Z.ai ↗ |
Full reported benchmark inventory
A dash means the publisher announcement did not report that result. It does not mean zero.
Percentage results
Scroll for more columns →
| Benchmark | Gemini 3.7 Flash | GLM-5.3 | DeepSeek-V4-Pro | Grok 4.6 | Muse Glimmer 30B | Qwen3.8-2.4T-A95B |
|---|---|---|---|---|---|---|
| FrontierCode 1.1 | 43.6%Google · 2026-08-13 ↗ | — | — | — | — | — |
| DeepSWE v1.1 | 65.3%Google · 2026-08-13 ↗ | 66.9%Z.ai · 2026-08-14 ↗ | — | 65.9%xAI · 2026-08-12 ↗ | — | 56.6Alibaba Cloud · 2026-08-03 ↗ |
| Terminal Bench 3.0 | — | 28.3%Z.ai · 2026-08-14 ↗ | — | 26%xAI · 2026-08-12 ↗ | — | — |
| CyberGym | — | 84.5%Z.ai · 2026-08-14 ↗ | 83.3DeepSeek · 2026-08-13 ↗ | — | — | — |
| ExploitBench | — | 54.4%Z.ai · 2026-08-14 ↗ | — | — | — | — |
| Terminal Bench 2.1 | — | — | 87.9DeepSeek · 2026-08-13 ↗ | — | 51.7Meta · 2026-08-10 ↗ | 86.6Alibaba Cloud · 2026-08-03 ↗ |
| HLE (with tools) | — | — | 60.0DeepSeek · 2026-08-13 ↗ | — | — | — |
| DeepSWE | — | — | 62.7DeepSeek · 2026-08-13 ↗ | — | — | — |
| Toolathlon-Verified | — | — | 74.1DeepSeek · 2026-08-13 ↗ | — | — | — |
| FrontierCode v1.1 (Extended) | — | — | — | 61.3%xAI · 2026-08-12 ↗ | — | — |
| CursorBench v3.2 | — | — | — | 69.9%xAI · 2026-08-12 ↗ | — | — |
| APEX-SWE | — | — | — | 56.4%xAI · 2026-08-12 ↗ | — | — |
| SWE-Bench Verified | — | — | — | — | 76.0Meta · 2026-08-10 ↗ | — |
| SWE-Bench Pro | — | — | — | — | 51.2Meta · 2026-08-10 ↗ | 67.7Alibaba Cloud · 2026-08-03 ↗ |
| OSWorld-Verified | — | — | — | — | 65.9Meta · 2026-08-10 ↗ | — |
| GPQA Diamond | — | — | — | — | 83.5Meta · 2026-08-10 ↗ | 92.6Alibaba Cloud · 2026-08-03 ↗ |
| HLE | — | — | — | — | — | 43.6Alibaba Cloud · 2026-08-03 ↗ |
Elo results
Scroll for more columns →
| Benchmark | Gemini 3.7 Flash | GLM-5.3 | DeepSeek-V4-Pro | Grok 4.6 | Muse Glimmer 30B | Qwen3.8-2.4T-A95B |
|---|---|---|---|---|---|---|
| WebDev Arena | 1588 EloGoogle · 2026-08-13 ↗ | — | — | — | — | — |
| GDPVal-AA v2 | — | — | — | 1753xAI · 2026-08-12 ↗ | — | — |
Task-count results
Scroll for more columns →
| Benchmark | Gemini 3.7 Flash | GLM-5.3 | DeepSeek-V4-Pro | Grok 4.6 | Muse Glimmer 30B | Qwen3.8-2.4T-A95B |
|---|---|---|---|---|---|---|
| ExploitGym · 2 hours | — | 105 tasksZ.ai · 2026-08-14 ↗ | — | — | — | — |
| ExploitGym · 6 hours | — | 130 tasksZ.ai · 2026-08-14 ↗ | — | — | — | — |
What is not independently confirmed
- Every figure on this page is self-reported by the cited publisher. MiniRouter did not run these benchmarks.
- Benchmark harnesses are not standardised. Results sharing a name across vendors have not been confirmed to use identical runs.
- Publisher pricing can change, and introductory phases have stated end dates.
- Catalog status is shown per model above. Dossier coverage is not a commitment to keep any route available.
Sources
- Read at Google ↗
Google announcement
Published Aug 13, 2026
- Read at Z.ai ↗
Z.ai announcement
Published Aug 14, 2026
- Read at DeepSeek ↗
DeepSeek GA release notes
Published Aug 13, 2026
- Read at xAI ↗
xAI announcement
Published Aug 12, 2026
- Read at Meta ↗
Meta AI Research announcement
Published Aug 10, 2026
- Read at Alibaba Cloud ↗
Alibaba Cloud announcement
Published Aug 3, 2026
Page revised 2026-08-14. Dates change only when the content changes.