Leaderboard
NVIDIA CMP 170HX 64GB ×6 (Ampere)
| Recipe | AA intel | C1 decode | C4 decode | C8 decode | Prefill | TTFT | Evidence | Votes |
|---|---|---|---|---|---|---|---|---|
| DeepSeek-V4.1-Flash SM80 DeepInfer kernel port 6x CMP 170HX DSpark K5 #1 | 39 | 160.8 tok/s | 170.5 tok/s | — | 4506.8 tok/s | 10700 ms | reported | 0 |
NVIDIA CMP 170HX 64GB ×3 (Ampere)
| Recipe | AA intel | C1 decode | C4 decode | C8 decode | Prefill | TTFT | Evidence | Votes |
|---|---|---|---|---|---|---|---|---|
| Qwen3.8-Flash-Next W4A16 3x CMP 170HX PP3 NVMe PLE fp8 KV 1M (clee) #1 | 40 | 74.9 tok/s | — | — | 4690 tok/s | 223000 ms | reported | 1 |
| DeepSeek V4 Flash-0731 abliterated on 3x CMP 170HX — vLLM patched PP3 DSpark K5 | 34 | 181 tok/s | — | — | 2350 tok/s | — | reported | 0 |
AMD Radeon AI Pro R9700 32GB ×2
| Recipe | AA intel | C1 decode | C4 decode | C8 decode | Prefill | TTFT | Evidence | Votes |
|---|---|---|---|---|---|---|---|---|
| Qwen3.8-27B PARO-MXFP6 2x Radeon AI PRO R9700 — vLLM radiance TP2 #1 | 34 | 138 tok/s | 321.6 tok/s | 394 tok/s | 3570 tok/s | — | reported | 0 |
Machine-readable: /api/v1/leaderboard.json (these boards) · /api/v1/scores.json (per-recipe medians).