diff --git a/recipes/qwen3-8-27b-int8-mtp3-prefix-cache-on-1x-cmp-170hx-hynix/recipe.yaml b/recipes/qwen3-8-27b-int8-mtp3-prefix-cache-on-1x-cmp-170hx-hynix/recipe.yaml index c3825a3df..68f95048b 100644 --- a/recipes/qwen3-8-27b-int8-mtp3-prefix-cache-on-1x-cmp-170hx-hynix/recipe.yaml +++ b/recipes/qwen3-8-27b-int8-mtp3-prefix-cache-on-1x-cmp-170hx-hynix/recipe.yaml @@ -152,3 +152,4 @@ provenance: - 'https://github.com/vllm-project/vllm/issues/45238' - 'https://wheels.vllm.ai/nightly' notes: "Submitted 2026-10-09 by localai-recipes from lar-scout ingest card t_35407999 (sweep QUEUE #3, 2026-10-09). Repo ahnguyen17/cmp-170hx-vllm @ 192cc330d9434e915bab05a2263944ae5fd12361 (HEAD via git ls-remote 2026-10-09; created 2026-08-20, 11 commits, actively maintained). Launch argv token-verified verbatim against serve-qwen38-nightly.sh at that sha; flag rationale cross-checked against script comments + README flag-by-flag table + docs/gdn-prefix-caching-2026-08-23.md; performance figures carried from the README A/B table and deep-dive probes as submitter-T0 with in-repo receipts (same-day A/B, 3-run medians, usage-counted). Engine pins: upstream nightly wheel vllm==0.26.1rc1.dev1024 from wheels.vllm.ai/nightly (commit 1fe3a1571ac67581478a11743e55a306de1d136f), torch 2.13.0+cu130, driver 610.43.03; model HF rev 7c12373712d1363e2b76655cb3332c9c124627d7. FIRST single-170HX recipe on the site (buckets were x2/x3/x4 only, verified live 2026-10-09); first GPTQ-int8/W8A16 lane on any 170HX recipe (site's other 170HX entries are W4A16/FP8/EXL3); first upstream-nightly vLLM 170HX entry (existing ones use forks). Documents the Hynix-vs-Samsung memory-bin split with working recipes for both. Hardware resolves to the pre-existing cmp-170hx single-card profile via the 0041 seed-slug convention (no orphan bucket)." +max_context_len: 262144