Official gold · Grok 4.6 Judge
Solar Mini4 beats Jev on judged quality
test400 · gold = Grok 4.6 Judge (Jev is a peer model, not gold) ·
Solar solar-mini4 → solar-mini4-260922 · reasoning_effort=none
98.4%
Solar field accuracy
3.2×
Jev faster (avg latency)
Accuracy @ Grok 4.6 Judge
Solar Mini4
Jev
miss fields Solar 7
miss fields Jev 26
choice tie @ 100%
Solar Mini4 matches the judge more often — especially on score & noul sign.
- 7 misses vs Jev’s 26 under the same gold
- score ≤1: 100% vs Jev 85% — calibration win
- KO 98.8% · EN 98.6% field accuracy
- Tradeoff: Jev still ~3.2× faster (0.38s vs 1.21s)
Language field accuracy
SolarJev
Scoreboard
| axis | Solar | Jev | winner |
|---|
| field accuracy | 98.4% | 94.2% | Solar |
| noul / score | 97.2 / 100 | 95.2 / 85 | Solar |
| choice | 100% | 100% | tie |
| KO / EN | 98.8 / 98.4 | 93.9 / 94.3 | Solar |
| avg latency | 1.21s | 0.38s | Jev |