| Result | Rank 1Grok 4.7 Medium | Rank 2GPT-6 Luna Low | Rank 3Claude Sonnet 5.5 Medium | Rank 4GPT-6 Sol Low | Rank 5Kimi K3 Low |
|---|---|---|---|---|---|
| Combined score | 76.24 | 62.62 | 62.01 | 60.67 | 58.98 |
| Judge | |||||
| Judge score /100 | 84.00 | 60.00 | 66.50 | 61.50 | 64.00 |
| Correctness /10 | 8 | 5 | 6 | 6 | 6 |
| Coverage /10 | 9 | 7 | 8 | 6 | 7 |
| Evidence /10 | 8 | 6 | 6 | 6 | 6 |
| Actionability /10 | 9 | 7 | 7 | 7 | 7 |
| Time | 628.97 s | 9.96 s | 100.86 s | 14.6 s | 313.38 s |
| Estimated USD | $0.234434 | $0.0015415 | $0.158896 | $0.028398 | $0.0773542 |
Cost estimates are reference estimates, not billed charges.
Frozen reference rate sheet: openrouter-rate-sheet-v1:d136d7bf3bdd121396516e965bdbddfb26414ec8725ca8c8bdee8ed2618e409c. API-equivalent estimate; subscription quota and charges are unknown.
Judge score uses recorded rubric metrics; final rank uses the combined score.
Component points and token usage
| Result | Rank 1 Grok 4.7 Medium | Rank 2 GPT-6 Luna Low | Rank 3 Claude Sonnet 5.5 Medium | Rank 4 GPT-6 Sol Low | Rank 5 Kimi K3 Low |
|---|---|---|---|---|---|
| Quality points | 75.6 | 54 | 59.85 | 55.35 | 57.6 |
| Test points | 0 | 0 | 0 | 0 | 0 |
| Speed points | 0.4354 | 4.2882 | 1.8649 | 4.0213 | 0.8035 |
| Cost points | 0.2046 | 4.3322 | 0.296 | 1.3022 | 0.5724 |
| Total input incl cache | 12,136 | 10,750 | 18,308 | 10,749 | 12,106 |
| Cache read (subset of input) | 1,152 | 0 | 0 | 0 | 0 |
| Cache write (subset of input) | 0 | 0 | 18,306 | 0 | 0 |
| Total output incl reasoning | 35,027 | 933 | 12,228 | 690 | 4,592 |
| Reasoning (subset of output) | N/A | N/A | N/A | N/A | N/A |
Swipe, scroll or use Previous and More to compare configurations. Row labels stay visible.
Advanced results and scoring details
security · 2026-10-14T05:49:13.353Z · Prospective evaluation. Equal transport and native system conditions are unverified.
Applied weights: quality 90%, tests 0%, speed 5%, cost 5%.
Displayed scores are rounded; pairwise outcomes use exact recorded fractions. Reference costs are estimates, not billed charges. Missing components follow the recorded assessment.
Pairwise results
- GPT-6 Sol Low vs Claude Sonnet 5.5 Medium: Second configuration wins
- GPT-6 Sol Low vs GPT-6 Luna Low: Second configuration wins
- GPT-6 Sol Low vs Grok 4.7 Medium: Second configuration wins
- GPT-6 Sol Low vs Kimi K3 Low: First configuration wins
- Claude Sonnet 5.5 Medium vs GPT-6 Luna Low: Second configuration wins
- Claude Sonnet 5.5 Medium vs Grok 4.7 Medium: Second configuration wins
- Claude Sonnet 5.5 Medium vs Kimi K3 Low: First configuration wins
- GPT-6 Luna Low vs Grok 4.7 Medium: Second configuration wins
- GPT-6 Luna Low vs Kimi K3 Low: First configuration wins
- Grok 4.7 Medium vs Kimi K3 Low: First configuration wins