← Leaderboard
Qwen3.8-27B MTPLX Optimized-Speed 4bit MLX (Youssofal)
Retired Rank #37 of 39 · 2/8 GAUNTLET progress
Hollow markers & dashed spokes: axis not yet scored
G
0
A
—
U
—
N
—
T
n/d
L
—
E
—
T
8.4
Specification
- Parameters
- 27B dense
- Architecture
- qwen3_5
- Size on disk
- 20.4 GB
- Quantization
- 4bit
- Format
- MLX
- Class
- Standard
- Reasoning (CoT)
- Yes — emits reasoning tokens
- Internal ID
- M25e
- Mean speed
- 20 tok/s across suites
- Stall census
- 1 stall in 1 observed tests (100.0%)
- Reasoning appetite
- 10,476 tokens mean · 10,476 max
- Model card
- huggingface.co
Suite results
Suite Score Avg / 20 Tests tok/s Run
General capability (13-task real-workload suite) 1a 0 / 260 0 13/13 20 run 2026-08-15
| Test | Category | Score | tok/s | |
|---|---|---|---|---|
| A1 | Dev/Ops Scripting | 0/20 | 20 |
Each test is LLM-judged 0–20 against a fixed rubric; suite max = tests × 20. Rows with a ▶ expand to the per-test breakdown. Where fewer tests ran than the suite total, unrun tests count as zero toward the axis score. See methodology.