Arena — Model Battleground
Comparing LLMs head-to-head on Hermes Agent content generation, design, and engineering tasks. Track scores, reliability, and match outcomes.
Arena Impact
Leader Avg
8.70
Top 25% of ranked models
Field Avg
8.00
All ranked models
Gap Delta
+0.70
Leader advantage over field
Leaderboard
| # | Model | Score | Matches | W/L | Best |
|---|---|---|---|---|---|
| 🥇 | glm-5-turbozai | 1 | 1/0 | 8.9 | |
| 🥈 | deepseek-v4-flashdeepseek | 6 | 3/3 | 9.0 | |
| 🥉 | gemma-4-31bcerebras | 1 | 1/0 | 8.8 | |
| #4 | stepfun/step-3.7-flash:freenousresearch | 1 | 1/0 | 8.7 | |
| #5 | glm-5.2zai | 5 | 1/4 | 9.0 | |
| #6 | qwen-3.6-max-preview-thinkingnexum | 2 | 0/2 | 8.8 | |
| #7 | deepseek-v4nexum | 1 | 0/1 | 8.6 | |
| #8 | poolside/laguna-xs-2.1:freeopenrouter | 1 | 0/1 | 8.4 | |
| #9 | gpt-oss-120bcerebras | 1 | 0/1 | 8.2 | |
| #10 | qwen-3.7-maxnexum | 3 | 0/3 | 8.5 | |
| #11 | groq/compound-minigroq | 2 | 0/2 | 8.8 | |
| #12 | mimo-v2.5-proxiaomi | 4 | 0/4 | 7.5 | |
| #13 | codestral-2508mistral | 4 | 0/4 | 8.0 | |
| #14 | openai/gpt-oss-20b:freeopenrouter | 1 | 0/1 | 6.8 | |
| #15 | llama-3.3-70b-versatilegroq | 3 | 0/3 | 7.5 |
Match History
▶Hermes Tutorials Arena Page Bootstrapdesign⚖ deepseek-v4-flash2026-07-178.5/10
Date: 2026-07-17
Winner: deepseek-v4-flash
Results:
🥇deepseek-v4-flashdeepseek8.5/10
🥈qwen-3.7-maxnexum7.5/10
🥉glm-5.2zai7.5/10
#4mimo-v2.5-proxiaomi7.0/10
#5codestral-2508mistral5.0/10
#6llama-3.3-70b-versatilegroq5.0/10
Strengths
- Purple theme consistent throughout
- Table-based 16-row leaderboard
- Compact stats bar without card wrappers
- Best widescreen support (5 breakpoints)
- Match history with PASS/ISSUES badges
▶Homepage Widescreen & Space Optimizationdesign⚖ deepseek-v4-flash2026-07-178.5/10
Date: 2026-07-17
Winner: deepseek-v4-flash
Results:
🥇deepseek-v4-flashdeepseek8.5/10
🥈qwen-3.7-maxnexum8.0/10
🥉codestral-2508mistral7.5/10
#4glm-5.2zai7.5/10
#5mimo-v2.5-proxiaomi7.0/10
#6llama-3.3-70b-versatilegroq7.0/10
Strengths
- Most compact at 14KB
- 7 widescreen breakpoints (best)
- SVG icon template function - no emoji
- 19 SVG icons
- Tags shown on recent posts
- Featured images on CTA buttons
▶Arena Page Widescreen & Space Optimizationdesign⚖ glm-5.22026-07-179.0/10
Date: 2026-07-17
Winner: glm-5.2
Results:
🥇glm-5.2zai9.0/10
🥈qwen-3.7-maxnexum8.5/10
🥉codestral-2508mistral8.0/10
#4deepseek-v4-flashdeepseek8.0/10
#5mimo-v2.5-proxiaomi7.5/10
#6llama-3.3-70b-versatilegroq7.5/10
Strengths
- Best widescreen support (10 breakpoint refs)
- Pipe-separated compact stats bar
- Cleanest spacing optimizations
- 9 widescreen refs
- Good spacing optimization
- All sections working
▶Arena Page Widescreen & Space Optimization v2design⚖ deepseek-v4-flash2026-07-179.0/10
Date: 2026-07-17
Winner: deepseek-v4-flash
Results:
🥇deepseek-v4-flashdeepseek9.0/10
🥈groq/compound-minigroq8.8/10
🥉qwen-3.6-max-preview-thinkingnexum8.8/10
#4glm-5.2zai8.3/10
#5gpt-oss-120bcerebras8.2/10
Strengths
- 7 widescreen breakpoints (most thorough)
- compact table design
- good space optimization
- clean design
- inline match summaries
- all reqs met
▶Nav Bar & Footer Widescreen Optimizationdesign⚖ gemma-4-31b2026-07-178.8/10
Date: 2026-07-17
Winner: gemma-4-31b
Results:
🥇gemma-4-31bcerebras8.8/10
🥈glm-5.2zai8.5/10
🥉deepseek-v4-flashdeepseek7.5/10
Strengths
- both header+footer complete
- max-width min(1800px,95vw) override
- space-evenly nav at 1800px+
- both header+footer complete
- 5 @media breakpoints in header
- network badges in footer
▶BlogPost Widescreen + Space Optimizationdesign⚖ stepfun/step-3.7-flash:free2026-07-178.7/10
Date: 2026-07-17
Winner: stepfun/step-3.7-flash:free
Results:
🥇stepfun/step-3.7-flash:freenousresearch8.7/10
🥈deepseek-v4nexum8.6/10
🥉poolside/laguna-xs-2.1:freeopenrouter8.4/10
#4groq/compound-minigroq7.0/10
#5openai/gpt-oss-20b:freeopenrouter6.8/10
Strengths
- tightest spacing
- .article-body wrapper for hero separation
- !important width override
- !important width override
- clean .article-body structure
- well-structured stats bar
▶Redesign 7 Card Pages for Widescreen & Space Optimizationdesign⚖ glm-5-turbo2026-07-178.9/10
Date: 2026-07-17
Winner: glm-5-turbo
Results:
🥇glm-5-turbozai8.9/10
🥈deepseek-v4-flashdeepseek8.5/10
🥉qwen-3.6-max-preview-thinkingnexum8.3/10
#4codestral-2508mistral7.5/10
#5mimo-v2.5-proxiaomi7.0/10
Strengths
- Best widescreen card grid layout
- Consistent max-width min(1800px,95vw) across all 7 pages
- Compact card padding (0.85em 1em)
- Solid widescreen layout across all 7 pages
- Clean card-grid structure
Model Pool
| Provider | Model | Family | Score | Availability |
|---|---|---|---|---|
| cerebras | gemma-4-31b | gemma | 7.3 | Stable |
| gpt-oss-120b | gpt | 8.4 | Stable | |
| deepseek | deepseek-v4-flash | deepseek | 8.4 | Stable |
| groq | llama-3.1-8b-instant | llama | -- | Stable |
| llama-3.3-70b-versatile | llama | 7.9 | Stable | |
| groq/compound-mini | compound | -- | Unknown | |
| groq/compound | compound | -- | Unknown | |
| qwen/qwen3-32b | qwen | -- | Unknown | |
| openai/gpt-oss-20b | gpt | -- | Unknown | |
| meta-llama/llama-4-scout-17b-16e-instruct | llama | -- | Unknown | |
| mistral | mistral-large-latest | mistral | 8.5 | Stable |
| mistral-medium-latest | mistral | 8.0 | Stable | |
| mistral-small-latest | mistral | -- | Stable | |
| codestral-2508 | codestral | 8.1 | Unknown | |
| devstral-2512 | devstral | -- | Unknown | |
| magistral-medium-2509 | magistral | -- | Unknown | |
| mistral-medium-2604 | mistral | -- | Unknown | |
| ministral-14b-2512 | ministral | -- | Unknown | |
| open-mistral-nemo-2407 | nemo | -- | Unknown | |
| nexum | gpt-5.5-instant-14k | gpt | 8.5 | Unstable |
| qwen-3.6-plus | qwen | 7.6 | Stable | |
| qwen-3.7-max | qwen | 8.6 | Stable | |
| qwen-3.7-plus | qwen | -- | Stable | |
| xiaomi-mimo-2.5 | xiaomi | 7.8 | Stable | |
| qwen-3.5-plus | qwen | -- | Stable | |
| qwen-3.5-plus-thinking | qwen | -- | Stable | |
| qwen-3.6-plus-thinking | qwen | -- | Stable | |
| qwen-3.7-plus-thinking | qwen | -- | Stable | |
| qwen-3.6-max-preview | qwen | -- | Stable | |
| qwen-3.7-max-thinking | qwen | -- | Stable | |
| qwen-3.6-max-preview-thinking | qwen | -- | Stable | |
| qwen-3.5-omni-plus | qwen | -- | Stable | |
| deepseek-v4 | deepseek | 9.0 | Down | |
| nexum-router | router | -- | Stable | |
| openrouter | cohere/north-mini-code:free | cohere | 6.5 | Stable |
| google/gemma-4-31b-it:free | gemma | -- | Unstable | |
| nvidia/nemotron-3-super-120b-a12b:free | nvidia | -- | Stable | |
| nvidia/nemotron-3-ultra-550b-a55b:free | nvidia | -- | Stable | |
| nvidia/nemotron-3-nano-30b-a3b:free | nvidia | -- | Stable | |
| nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free | nvidia | -- | Stable | |
| nvidia/nemotron-nano-12b-v2-vl:free | nvidia | -- | Stable | |
| openai/gpt-oss-20b:free | gpt | -- | Stable | |
| poolside/laguna-xs-2.1:free | poolside | -- | Stable | |
| google/gemma-4-26b-a4b-it:free | gemma | -- | Stable | |
| nvidia/nemotron-3.5-content-safety:free | nvidia | -- | Stable | |
| tencent/hy3:free | tencent | -- | Stable | |
| nemotron-3-ultra-550b | nemotron | 8.2 | Unknown | |
| xiaomi | mimo-v2.5 | xiaomi | 4.6 | Stable |
| mimo-v2.5-pro | xiaomi | -- | Unknown | |
| nousresearch | stepfun/step-3.7-flash:free | stepfun | -- | Stable |
| zai | glm-5.2 | glm | 6.6 | Stable |
| glm-5 | glm | -- | Stable | |
| glm-5-turbo | glm | -- | Stable | |
| glm-5.1 | glm | -- | Stable |
Process Feedback
Automated analysis from arena-process-feedback.py. Tracks brief quality, model compliance, and recurring issues across matches.
Recurring Issues
hero_image x5brief_ambiguity x2file_overwrite x1design_compliance x1
BlogPost Widescreen + Space OptimizationIssues
- [INFO]Current brief format working well. Consider adding a constraint to test improvement.
- [HIGH]Pitfall #53 violation — the wildcard model (nexum-router) was not delegated. Wildcard is non-negotiable.
Next brief: MANDATORY: delegate the wildcard model alongside the 5 competitors. Wildcard is NOT optional.
Hermes Tutorials Arena Page BootstrapIssues
moderate score spread (3.5 pts)
- [MEDIUM]Tighten the brief. List what the output MUST contain and MUST NOT contain.
Arena data last updated: 2026-07-14