Leaderboard
NVIDIA dgx-station-gb300 288GB ×2 (Blackwell)
| Recipe | AA intel | C1 decode | C4 decode | C8 decode | Prefill | TTFT | Evidence | Votes |
|---|---|---|---|---|---|---|---|---|
| DeepSeek V4.1 Flash 1017 FP8 TP1xPP2 DSpark 2x DGX Station GB300 RoCE vLLM 0.31 overlay #1 | 45 | 391 tok/s | 595 tok/s | 974 tok/s | — | — | reported | 0 |
NVIDIA RTX PRO 6000 Blackwell 96GB ×2
| Recipe | AA intel | C1 decode | C4 decode | C8 decode | Prefill | TTFT | Evidence | Votes |
|---|---|---|---|---|---|---|---|---|
| GLM-5.3-Flash QAD (CSF) on 2x RTX PRO 6000 Blackwell — TP2/DCP2 MTP3 #1 | 42 | 207 tok/s | 488 tok/s | 672 tok/s | — | — | reported | 0 |
| DeepSeek V4 Flash Vision on 2x RTX PRO 6000 Blackwell \x{2014} TP2 DSpark K3 | 35 | 169.2 tok/s | 394.7 tok/s | — | 8993 tok/s | — | reported | 0 |
| DeepSeek V4 Flash-0731 on 2x RTX PRO 6000 Blackwell \x{2014} TP2 DSpark K5 | 34 | 214.9 tok/s | — | 611.9 tok/s | 11167 tok/s | — | reported | 0 |
NVIDIA CMP 170HX 64GB ×3 (Ampere)
| Recipe | AA intel | C1 decode | C4 decode | C8 decode | Prefill | TTFT | Evidence | Votes |
|---|---|---|---|---|---|---|---|---|
| Qwen3.8-Flash-Next W4A16 3x CMP 170HX PP3 NVMe PLE fp8 KV 1M (clee) #1 | 40 | 74.9 tok/s | — | — | 4690 tok/s | 223000 ms | reported | 1 |
| DeepSeek V4 Flash-0731 abliterated on 3x CMP 170HX — vLLM patched PP3 DSpark K5 | 34 | 181 tok/s | — | — | 2350 tok/s | — | reported | 0 |
Machine-readable: /api/v1/leaderboard.json (these boards) · /api/v1/scores.json (per-recipe medians).