← Leaderboard
Qwen3.8-27B MLX 6bit (lmstudio-community)
Tested Rank #20 of 35 · 3/8 GAUNTLET progress
Hollow markers & dashed spokes: axis not yet scored
G
51.9
A
75
U
—
N
—
T
n/d
L
—
E
—
T
6.7
Specification
- Parameters
- 27B dense
- Architecture
- qwen3_5
- Size on disk
- 21 GB
- Quantization
- 6bit
- Format
- MLX
- Reasoning (CoT)
- Yes — emits reasoning tokens
- Internal ID
- M25f
- Mean speed
- 15.9 tok/s across suites
- Model card
- huggingface.co
Suite results
| Suite | Score | Avg / 20 | Tests | tok/s |
|---|---|---|---|---|
| General capability (13-task real-workload suite) 1a | 134.9 / 260 | 10.4 | 13/13 | 14.1 |
| Agentic tool-calling & protocol adherence 1b | 120 / 160 | 15 | 8/8 | 17.8 |
Each test is LLM-judged 0–20 against a fixed rubric; suite max = tests × 20. Where fewer tests ran than the suite total, unrun tests count as zero toward the axis score. See methodology.