Leaderboard
NVIDIA dgx-station-gb300 288GB ×2 (Blackwell)
| Recipe | AA intel | C1 decode | C4 decode | C8 decode | Prefill | TTFT | Evidence | Votes |
|---|---|---|---|---|---|---|---|---|
| DeepSeek V4.1 Flash 1017 FP8 TP1xPP2 DSpark 2x DGX Station GB300 RoCE vLLM 0.31 overlay #1 | 45 | 391 tok/s | 595 tok/s | 974 tok/s | — | — | reported | 0 |
NVIDIA RTX 5090 32GB ×2 (Blackwell)
| Recipe | AA intel | C1 decode | C4 decode | C8 decode | Prefill | TTFT | Evidence | Votes |
|---|---|---|---|---|---|---|---|---|
| GLM-5.3-Flash EXL3 2.05bpw on 2x RTX 5090 - TabbyAPI hot-expert swaps, 262K ctx, vision #1 | 42 | 62.9 tok/s | 98 tok/s | — | 2023 tok/s | 480 ms | reported | 0 |
NVIDIA RTX 3090 24GB ×4 (Ampere)
| Recipe | AA intel | C1 decode | C4 decode | C8 decode | Prefill | TTFT | Evidence | Votes |
|---|---|---|---|---|---|---|---|---|
| Qwen3.8-Flash-Next W4A16-Merlin on 4x RTX 3090 — TP2xPP2+EP, MTP3, FP8 KV, 925K pool (halt95) #1 | 40 | 174.3 tok/s | — | 533.7 tok/s | 5484 tok/s | 960 ms | reported | 0 |
| Qwen3.8-27B AWQ-INT4 + DSpark on RTX 3090s — SGLang TP1/TP2/TP4 | 34 | 136.8 tok/s | 103.8 tok/s | 60.5 tok/s | 1615.8 tok/s | 98880 ms | reported | 0 |
Machine-readable: /api/v1/leaderboard.json (these boards) · /api/v1/scores.json (per-recipe medians).