diff --git a/recipes/qwen3-8-flash-next-nvfp4-2x-cmp-170hx-tep2-gds-ssd-ple-mtp6/recipe.yaml b/recipes/qwen3-8-flash-next-nvfp4-2x-cmp-170hx-tep2-gds-ssd-ple-mtp6/recipe.yaml index e7984fad9..31e0f1bc7 100644 --- a/recipes/qwen3-8-flash-next-nvfp4-2x-cmp-170hx-tep2-gds-ssd-ple-mtp6/recipe.yaml +++ b/recipes/qwen3-8-flash-next-nvfp4-2x-cmp-170hx-tep2-gds-ssd-ple-mtp6/recipe.yaml @@ -141,3 +141,4 @@ provenance: source_urls: - 'https://github.com/nguyenthimy2022kg-alt/Qwen-Flash-SM80-170HX' notes: "Recipe by nguyenthimy2022kg-alt (community project, Apache-2.0); submitter/listed_by = localai-recipes. Source pinned at git HEAD 31816b79fbbc69c468171385f89f339f0bd29ff3 (tag v0.2.0 = 11421471c050cccc036b004e91345583e33993b2, pushed 2026-10-10; HEAD adds commits f3bfb5d/93f34c8: OPTIONAL PLE host-read backend for sync_mt direct-read debugging - default remains SSD-to-GPU GDS, disabled by default, requires rebuild). Deploy docs are Chinese; launch argv transcribed from config/vllm-args.json + scripts/serve.py + docs/DEPLOYMENT.en.md at the pin, flags verified against serve.py gates (mode tep2/tp2, exactly 2 distinct GPU ids, draft_int8 hard-required true in v0.2.0, use_local_argmax_reduction tied to it; tp2 mode strips --enable-expert-parallel). Performance numbers are the 2026-09-08 pre-v0.2.0 RadixArk campaign (README/性能记录.md); kept as-of honest per card. context_len 2048 in the points array is a marker for the short-prompt band, not a measured context. 'MTP6' = MTP depth 6 per repo docs; speculative window num_speculative_tokens=32 is the draft capacity for 16/32-token history fragments (repo: 'not MTP32'). v0.2.0 regression: 28-request + 20-turn same-session regression incl. ~260K input" +max_context_len: 262144