Independent benchmark · Spanish

The ranking of AI models in Spanish

11 frontier models, 25 real-world tests, 6 families. Pre-registered methodology, automated judges with recusal by lab, and every raw response published. Every cell in the table opens and can be read.
Models
11
Tests
25
Runs
4
Responses
1,100
1.0

Tiers

Sorted by overall score
ranking.sozpic.com
S
≥ 90
A
Claude Fable 5.1
Anthropic
97.3%
O
GPT-6 Astra
OpenAI
96.5%
A
Claude Opus 5.5
Anthropic
96.5%
A
80–89
M
Kimi K3
Moonshot
89.2%
O
GPT-5.6 Sol
OpenAI
87.2%
x
Grok 4.7
xAI
87.1%
G
Gemini 3.8 Flash
Google
81%
B
70–79
D
DeepSeek V4.1-Flash
DeepSeek
77.5%
G
Gemini 3.1 Pro
Google
71.2%
C
60–69
D
DeepSeek V4 Pro
DeepSeek
67.3%
M
Mistral Large 4
Mistral
65.1%
D
< 60
S ≥ 90 · A 80–89 · B 70–79 · C 60–69 · D < 60
2.0

Table

No empty cells. Every one of them opens.
Overall score: the unweighted mean of the 6 families.
Ranking IA — overall and per-family scores of 11 frontier models in Spanish. 8 runs, latest measurement October 11, 2026; each model keeps the run it was measured in. Scores as a percentage of the rubric maximum.
#ModelLabOverallTier95% CIOutput price $/1MInstructionsTruthfulnessReasoningCharacterExpressionSpanishConsistency
1 Claude Fable 5.1
claude-fable-5-1
Anthropic 97.3% S 95.7–98.8 50 98.3%100%91.7%100%98.4%95.3% ±2.1
2 GPT-6 Astra
gpt-6-astra
OpenAI 96.5% S 95.3–98 50 99.3%100%87.5%94.6%97.7%100% ±2.3
2 Claude Opus 5.5
claude-opus-5-5
Anthropic 96.5% S 95.2–97.8 20 97.2%98.3%98.6%96.4%88.4%100% ±3.9
4 Kimi K3
accounts/fireworks/models/kimi-k3
Moonshot 89.2% A 86.5–91.7 15 84.9%97.5%77.1%96.4%94.8%84.4% ±6.2
5 GPT-5.6 Sol
gpt-5.6-sol
OpenAI 87.2% A 85.2–89.2 20 100%93.3%83.3%75.6%86.6%84.4% ±6
6 Grok 4.7
grok-4.7
xAI 87.1% A 83.5–90.5 6 88.9%95.8%91.7%100%88.9%57.3% ±7.1
7 Gemini 3.8 Flash
gemini-3.8-flash
Google 81% A 78.6–83.3 3.8 92.4%76.7%84.7%57.1%95.8%79.2% ±5.3
8 DeepSeek V4.1-Flash
deepseek-flash
DeepSeek 77.5% B 74.1–80.7 1.2 81.2%97.5%70.8%54.9%87.2%73.5% ±9.1
9 Gemini 3.1 Pro
gemini-3.1-pro-preview
Google 71.2% B 68.4–73.8 12 66%66.7%79.2%42.9%86.1%86.5% ±7.5
10 DeepSeek V4 Pro
deepseek-v4-pro
DeepSeek 67.3% C 63.2–71.3 4 82.3%61.3%72.9%32.6%81.3%73.4% ±13.5
11 Mistral Large 4
mistral-large-4-0
Mistral 65.1% C 62.6–67.5 2.1 63.6%88.1%59.4%44.6%73.6%61% ±9.2
▲ ≥ 75■ 40 – 75▼ < 40Consistency: deviation across the runs of each test, in percentage points.
3.0

Head to head

Tests won by family, and the same test side by side.
VS
4.0

Score versus cost

Each dot is a model: top left means a higher score for less money.
5.0

Model pages

Each model, test by test, on its own page.