Leaderboard
NVIDIA dgx-station-gb300 288GB ×2 (Blackwell)
| Recipe | AA intel | C1 decode | C4 decode | C8 decode | Prefill | TTFT | Evidence | Votes |
|---|---|---|---|---|---|---|---|---|
| DeepSeek V4.1 Flash 1017 FP8 TP1xPP2 DSpark 2x DGX Station GB300 RoCE vLLM 0.31 overlay #1 | 45 | 391 tok/s | 595 tok/s | 974 tok/s | — | — | reported | 0 |
NVIDIA CMP 170HX 64GB ×6 (Ampere)
| Recipe | AA intel | C1 decode | C4 decode | C8 decode | Prefill | TTFT | Evidence | Votes |
|---|---|---|---|---|---|---|---|---|
| DeepSeek-V4.1-Flash SM80 DeepInfer kernel port 6x CMP 170HX DSpark K5 #1 | 39 | 160.8 tok/s | 170.5 tok/s | — | 4506.8 tok/s | 10700 ms | reported | 0 |
NVIDIA CMP 170HX 64GB ×1 (Ampere)
| Recipe | AA intel | C1 decode | C4 decode | C8 decode | Prefill | TTFT | Evidence | Votes |
|---|---|---|---|---|---|---|---|---|
| Qwen3.8-Flash-Next 3bpw FP8-PLE 1x CMP 170HX DFlash2 RecoverSSM #1 | 40 | 296.4 tok/s | — | 799.5 tok/s | 4243 tok/s | — | reported | 0 |
| Qwen3.8-Flash-Next 3bpw MTP on 1x CMP 170HX SSD PLE AIO (iIIusi0n) | 40 | 111 tok/s | 78 tok/s | 61 tok/s | 2636 tok/s | 105 ms | reported | 0 |
| Qwen3.8-27B INT8 MTP3 prefix-cache on 1x CMP 170HX Hynix | 34 | 79 tok/s | — | — | — | — | reported | 0 |
AMD Radeon AI Pro R9700 32GB ×1
| Recipe | AA intel | C1 decode | C4 decode | C8 decode | Prefill | TTFT | Evidence | Votes |
|---|---|---|---|---|---|---|---|---|
| Qwen3.8-27B MXFP4 DFlash2 1x Radeon AI PRO R9700 WSL2 radiance #1 | 34 | 145 tok/s | — | — | 2762 tok/s | 12580 ms | reported | 0 |
Machine-readable: /api/v1/leaderboard.json (these boards) · /api/v1/scores.json (per-recipe medians).