| # | Model | Lab | Overall | Tier | 95% CI | Output price $/1M | Instructions | Truthfulness | Reasoning | Character | Expression | Spanish | Consistency |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | Claude Fable 5.1 claude-fable-5-1 |
Anthropic | 97.3% | S | 95.7–98.8 | 50 | 98.3% | 100% | 91.7% | 100% | 98.4% | 95.3% | ±2.1 |
| 2 | GPT-6 Astra gpt-6-astra |
OpenAI | 96.5% | S | 95.3–98 | 50 | 99.3% | 100% | 87.5% | 94.6% | 97.7% | 100% | ±2.3 |
| 2 | Claude Opus 5.5 claude-opus-5-5 |
Anthropic | 96.5% | S | 95.2–97.8 | 20 | 97.2% | 98.3% | 98.6% | 96.4% | 88.4% | 100% | ±3.9 |
| 4 | Kimi K3 accounts/fireworks/models/kimi-k3 |
Moonshot | 89.2% | A | 86.5–91.7 | 15 | 84.9% | 97.5% | 77.1% | 96.4% | 94.8% | 84.4% | ±6.2 |
| 5 | GPT-5.6 Sol gpt-5.6-sol |
OpenAI | 87.2% | A | 85.2–89.2 | 20 | 100% | 93.3% | 83.3% | 75.6% | 86.6% | 84.4% | ±6 |
| 6 | Grok 4.7 grok-4.7 |
xAI | 87.1% | A | 83.5–90.5 | 6 | 88.9% | 95.8% | 91.7% | 100% | 88.9% | 57.3% | ±7.1 |
| 7 | Gemini 3.8 Flash gemini-3.8-flash |
81% | A | 78.6–83.3 | 3.8 | 92.4% | 76.7% | 84.7% | 57.1% | 95.8% | 79.2% | ±5.3 | |
| 8 | DeepSeek V4.1-Flash deepseek-flash |
DeepSeek | 77.5% | B | 74.1–80.7 | 1.2 | 81.2% | 97.5% | 70.8% | 54.9% | 87.2% | 73.5% | ±9.1 |
| 9 | Gemini 3.1 Pro gemini-3.1-pro-preview |
71.2% | B | 68.4–73.8 | 12 | 66% | 66.7% | 79.2% | 42.9% | 86.1% | 86.5% | ±7.5 | |
| 10 | DeepSeek V4 Pro deepseek-v4-pro |
DeepSeek | 67.3% | C | 63.2–71.3 | 4 | 82.3% | 61.3% | 72.9% | 32.6% | 81.3% | 73.4% | ±13.5 |
| 11 | Mistral Large 4 mistral-large-4-0 |
Mistral | 65.1% | C | 62.6–67.5 | 2.1 | 63.6% | 88.1% | 59.4% | 44.6% | 73.6% | 61% | ±9.2 |