Leaderboard
NVIDIA CMP 170HX 64GB ×3 (Ampere)
| Recipe | AA intel | C1 decode | C4 decode | C8 decode | Prefill | TTFT | Evidence | Votes |
|---|---|---|---|---|---|---|---|---|
| Qwen3.8-Flash-Next W4A16 3x CMP 170HX PP3 NVMe PLE fp8 KV 1M (clee) #1 | 40 | 74.9 tok/s | — | — | 4690 tok/s | 223000 ms | reported | 1 |
| DeepSeek V4 Flash-0731 abliterated on 3x CMP 170HX — vLLM patched PP3 DSpark K5 | 34 | 181 tok/s | — | — | 2350 tok/s | — | reported | 0 |
NVIDIA CMP 170HX 64GB ×1 (Ampere)
| Recipe | AA intel | C1 decode | C4 decode | C8 decode | Prefill | TTFT | Evidence | Votes |
|---|---|---|---|---|---|---|---|---|
| Qwen3.8-Flash-Next 3bpw FP8-PLE 1x CMP 170HX DFlash2 RecoverSSM #1 | 40 | 296.4 tok/s | — | 799.5 tok/s | 4243 tok/s | — | reported | 0 |
| Qwen3.8-Flash-Next 3bpw MTP on 1x CMP 170HX SSD PLE AIO (iIIusi0n) | 40 | 111 tok/s | 78 tok/s | 61 tok/s | 2636 tok/s | 105 ms | reported | 0 |
| Qwen3.8-27B INT8 MTP3 prefix-cache on 1x CMP 170HX Hynix | 34 | 79 tok/s | — | — | — | — | reported | 0 |
NVIDIA RTX 3090 24GB ×4 (Ampere)
| Recipe | AA intel | C1 decode | C4 decode | C8 decode | Prefill | TTFT | Evidence | Votes |
|---|---|---|---|---|---|---|---|---|
| Qwen3.8-Flash-Next W4A16-Merlin on 4x RTX 3090 — TP2xPP2+EP, MTP3, FP8 KV, 925K pool (halt95) #1 | 40 | 174.3 tok/s | — | 533.7 tok/s | 5484 tok/s | 960 ms | reported | 0 |
| Qwen3.8-27B AWQ-INT4 + DSpark on RTX 3090s — SGLang TP1/TP2/TP4 | 34 | 136.8 tok/s | 103.8 tok/s | 60.5 tok/s | 1615.8 tok/s | 98880 ms | reported | 0 |
NVIDIA RTX 3090 24GB ×1 (Ampere)
| Recipe | AA intel | C1 decode | C4 decode | C8 decode | Prefill | TTFT | Evidence | Votes |
|---|---|---|---|---|---|---|---|---|
| GLM-5.3-Flash EXL3 3.05bpw on 1x RTX 3090 — RAM/NVMe expert tiering (near-exact) #1 | 42 | 28.2 tok/s | — | — | 1015 tok/s | — | reported | 0 |
| Qwen3.8-Flash-Next W4A16-FP8PLE on 1x RTX 3090 — CPU cold experts, MTP3, 128K (DominikBucko) | 40 | 50.3 tok/s | — | — | 2141 tok/s | 62200 ms | reported | 0 |
| Qwen3.8-27B AWQ-INT4 + DSpark on RTX 3090s — SGLang TP1/TP2/TP4 | 34 | 136.8 tok/s | 103.8 tok/s | 60.5 tok/s | 1615.8 tok/s | 98880 ms | reported | 0 |
AMD Radeon AI Pro R9700 32GB ×1
| Recipe | AA intel | C1 decode | C4 decode | C8 decode | Prefill | TTFT | Evidence | Votes |
|---|---|---|---|---|---|---|---|---|
| Qwen3.8-27B MXFP4 DFlash2 1x Radeon AI PRO R9700 WSL2 radiance #1 | 34 | 145 tok/s | — | — | 2762 tok/s | 12580 ms | reported | 0 |
Machine-readable: /api/v1/leaderboard.json (these boards) · /api/v1/scores.json (per-recipe medians).