Leaderboard
NVIDIA DGX Spark 128GB ×4 (Blackwell)
| Recipe | AA intel | C1 decode | C4 decode | C8 decode | Prefill | TTFT | Evidence | Votes |
|---|---|---|---|---|---|---|---|---|
| GLM-5.3-Flash NVFP4 4x DGX Spark switchless ring TP4 DFlash2 #1 | 42 | 45.6 tok/s | 110.8 tok/s | — | 36074.9 tok/s | 1817 ms | reported | 0 |
| DeepSeek-V4.1-Flash on 4x DGX Spark — tuned TP4 SGLang/DSpark | 39 | 89.7 tok/s | 165.9 tok/s | 244.6 tok/s | 5664 tok/s | — | reported | 0 |
| GLM-5.3-Flash exlr8 EXL3 experts on DGX Spark TP1-4 | n/a | 128 tok/s | — | — | 4393 tok/s | — | reported | 0 |
NVIDIA DGX Spark 128GB ×2 (Blackwell)
| Recipe | AA intel | C1 decode | C4 decode | C8 decode | Prefill | TTFT | Evidence | Votes |
|---|---|---|---|---|---|---|---|---|
| Qwen3.8-Flash-Next Uncensored NVFP4 2x DGX Spark SGLang TP2 ROCE #1 | 40 | 40.3 tok/s | 117.3 tok/s | 120.5 tok/s | 2976.7 tok/s | — | reported | 0 |
| GLM-5.3-Flash exlr8 EXL3 experts on DGX Spark TP1-4 | n/a | 128 tok/s | — | — | 4393 tok/s | — | reported | 0 |
NVIDIA RTX 3090 24GB ×2 (Ampere)
| Recipe | AA intel | C1 decode | C4 decode | C8 decode | Prefill | TTFT | Evidence | Votes |
|---|---|---|---|---|---|---|---|---|
| DeepSeek-V4.1-Flash-1017 dsx 2.6-bit GPTQ 2x RTX 3090 (Engram) #1 | 45 | 26 tok/s | — | — | 170 tok/s | — | reported | 0 |
| GLM-5.3-Flash EXL3 3.05bpw on 2x RTX 3090 — vLLM + ExLlamaV3 CPU expert offload, 256K (DominikBucko) | 42 | 50.4 tok/s | — | — | 1155 tok/s | 235260 ms | reported | 0 |
| Qwen3.8-Flash-Next W4A16-FP8PLE on 2x RTX 3090 — TP2, expert-offload, MTP3 (DominikBucko) | 40 | 109.8 tok/s | — | — | 3029 tok/s | 90800 ms | reported | 0 |
| Qwen3.8-27B AWQ-INT4 + DSpark on RTX 3090s — SGLang TP1/TP2/TP4 | 34 | 136.8 tok/s | 103.8 tok/s | 60.5 tok/s | 1615.8 tok/s | 98880 ms | reported | 0 |
NVIDIA RTX 3090 24GB ×1 (Ampere)
| Recipe | AA intel | C1 decode | C4 decode | C8 decode | Prefill | TTFT | Evidence | Votes |
|---|---|---|---|---|---|---|---|---|
| GLM-5.3-Flash EXL3 3.05bpw on 1x RTX 3090 — RAM/NVMe expert tiering (near-exact) #1 | 42 | 28.2 tok/s | — | — | 1015 tok/s | — | reported | 0 |
| Qwen3.8-Flash-Next W4A16-FP8PLE on 1x RTX 3090 — CPU cold experts, MTP3, 128K (DominikBucko) | 40 | 50.3 tok/s | — | — | 2141 tok/s | 62200 ms | reported | 0 |
| Qwen3.8-27B AWQ-INT4 + DSpark on RTX 3090s — SGLang TP1/TP2/TP4 | 34 | 136.8 tok/s | 103.8 tok/s | 60.5 tok/s | 1615.8 tok/s | 98880 ms | reported | 0 |
Machine-readable: /api/v1/leaderboard.json (these boards) · /api/v1/scores.json (per-recipe medians).