Leaderboard
NVIDIA DGX Spark 128GB ×3 (Blackwell)
| Recipe | AA intel | C1 decode | C4 decode | C8 decode | Prefill | TTFT | Evidence | Votes |
|---|---|---|---|---|---|---|---|---|
| GLM-5.3-Flash exlr8 EXL3 experts on DGX Spark TP1-4 #1 | n/a | 128 tok/s | — | — | 4393 tok/s | — | reported | 0 |
NVIDIA DGX Spark 128GB ×2 (Blackwell)
| Recipe | AA intel | C1 decode | C4 decode | C8 decode | Prefill | TTFT | Evidence | Votes |
|---|---|---|---|---|---|---|---|---|
| GLM-5.3-Flash NVFP4 on 2x DGX Spark - Atlas RC4.2 TP2, DFlash2, 1M #1 | 42 | 91.7 tok/s | 70.9 tok/s | — | — | — | reported | 0 |
| Qwen3.8-Flash-Next Uncensored NVFP4 2x DGX Spark SGLang TP2 ROCE | 40 | 40.3 tok/s | 117.3 tok/s | 120.5 tok/s | 2976.7 tok/s | — | reported | 0 |
| GLM-5.3-Flash exlr8 EXL3 experts on DGX Spark TP1-4 | n/a | 128 tok/s | — | — | 4393 tok/s | — | reported | 0 |
NVIDIA RTX PRO 6000 Blackwell 96GB ×1
| Recipe | AA intel | C1 decode | C4 decode | C8 decode | Prefill | TTFT | Evidence | Votes |
|---|---|---|---|---|---|---|---|---|
| GLM-5.3-Flash EXL3 3.05bpw on 1x RTX PRO 6000 - GPU expert cache, host-RAM streaming #1 | 42 | 68.3 tok/s | — | — | 2851.4 tok/s | — | reported | 0 |
| Qwen3.8-Flash-Next NVFP4 RTX PRO 6000 Blackwell SM120 SGLang | 40 | 227.8 tok/s | — | — | 14235.1 tok/s | 10101 ms | reported | 0 |
| Qwen3.8-Flash-Next NVFP4 RTX PRO 6000 Blackwell SGLang NVMe PLE | 40 | 180.9 tok/s | 408 tok/s | — | 9990 tok/s | 92 ms | reported | 0 |
| Qwen3.8-Flash-Next NVFP4 on RTX PRO 6000 Blackwell — TP1 MTP3 | 40 | 157.6 tok/s | — | 674.2 tok/s | 12104 tok/s | — | reported | 1 |
| Qwen3.8-27B NVFP4A4-AWQ 1x RTX PRO 6000 SGLang Fast Decode | 34 | 149 tok/s | 117 tok/s | 40 tok/s | — | — | reported | 0 |
| Qwen3.8-27B Bit-Exact Spec-Decode 1x RTX PRO 6000 SGLang | 34 | 106.6 tok/s | — | — | — | 68500 ms | reported | 0 |
Machine-readable: /api/v1/leaderboard.json (these boards) · /api/v1/scores.json (per-recipe medians).