diff --git a/recipes/qwen3-8-27b-bit-exact-spec-decode-1x-rtx-pro-6000-sglang/recipe.yaml b/recipes/qwen3-8-27b-bit-exact-spec-decode-1x-rtx-pro-6000-sglang/recipe.yaml index deb04212d..7a7959e95 100644 --- a/recipes/qwen3-8-27b-bit-exact-spec-decode-1x-rtx-pro-6000-sglang/recipe.yaml +++ b/recipes/qwen3-8-27b-bit-exact-spec-decode-1x-rtx-pro-6000-sglang/recipe.yaml @@ -130,3 +130,4 @@ provenance: - 'https://github.com/bill-h-lin/sglang-exact-spec-decode' - 'https://www.reddit.com/r/LocalLLaMA/comments/1x3sx3d/' notes: "Ingested from repo HEAD e0deb2658e311387f8103ba27d52ef932bdc543e (2026-10-15) by localai-recipes; the repo was rewritten after the scout snapshot (card pinned 952d88e4, which no longer resolves) - history db00c95/cbfed1e/e0deb26, same three patches, e0deb26 adds the DeepGEMM 0.2.2/0.2.3rc0 still-unfenced note. Every launch flag verified against SGLang arg_groups fields at 542a043f1b68796d269ef1ee11be7865f8d4a5f1 (enable_deterministic_inference, mamba_ssm_dtype choices incl float32, DFLASH builtin, --model-path / --speculative-draft-model-path spellings); SGLANG_BATCH_INVARIANT_OPS_SMALL_M_TRITON verified against patch 2's own sm120/121 gate. HF pins resolved live: Qwen/Qwen3.8-27B @ 1d4bf0f2, incoai/Qwen3.8-27B-DFlash2 @ 015e7956. Card corrections: drafter is incoai (card said z-lab); DeepGEMM upgrade caveat added by e0deb26. Numbers are author-measured T0 from the README table at e0deb26; the r/LocalLLaMA thread (1x3sx3d) not re-verified (403 lane). context_len 640 on the first point is a bucket marker for the README short-prompts column (repeatability battery prompts ran 560-740 tokens); 2183/127735 are the parity battery's measured prompt lengths." +max_context_len: 262144