diff --git a/recipes/qwen3-8-flash-next-int4-mixed-170hx-x2-pp2-mtp3-bf16-kv-ple-nvme/recipe.yaml b/recipes/qwen3-8-flash-next-int4-mixed-170hx-x2-pp2-mtp3-bf16-kv-ple-nvme/recipe.yaml index e9ff4b157..ee2f86629 100644 --- a/recipes/qwen3-8-flash-next-int4-mixed-170hx-x2-pp2-mtp3-bf16-kv-ple-nvme/recipe.yaml +++ b/recipes/qwen3-8-flash-next-int4-mixed-170hx-x2-pp2-mtp3-bf16-kv-ple-nvme/recipe.yaml @@ -144,3 +144,6 @@ provenance: - 'https://minamism.com/posts/flash-next-vllm/' - 'https://minamism.com/posts/flash-next-vllm-optimization/' notes: "Page-reference ingest (owner directive, card t_4021075f): source is a blog writeup with no git HEAD - reference artifact is the article URL + as-of date 2026-10-07, page-watch pin goes to the lar-scout git-watch lane. All launch flags/config transcribed verbatim from the page's LLM-instructions section; every pinned upstream verified live at ingest time: HF snapshot 6a995be5542081bb65d9b7e8f580f0b8220ce0e7 resolves and equals branch 4x3090 (65 files: 17 body shards + 33 PLE shards BF16 [320001536,160] ~95.4 GiB + MTP overlay outputs; quant compressed-tensors mixed - routed experts INT4 gs32, linear_attn/QSA/shared + hyper-connection + lm_head/embed/PLE-proj INT8, router/vision/PLE table/MTP BF16); docker digest 43f13b4c624ab9e9e6753d0eeb5953268bff334f2a826239e6f4a2197d47bb96 resolves on hub (tags 0.29.1rc1.dev47 / nightly-5f93dd53, 22 GB); patch tree f6f90ddc39e9d212aa5b96f43999183deb4ce192 on branch main carries vllm-patch/2x24GB (flash-next-vllm.patch, decode-01..07, ttft-01, mem-01, vision-01, upstream-01) + vllm-patch/3x24GB+MTP (mtp-01-enable, mtp-02-three-cards, mtp-03-structured-output-drafts, make_mtp_int4.py); NOTICE names the patches Minachist derivative works under Apache-2.0 EXCEPT upstream-01 = vLLM PR #55506 by Karl0007 (root cause first found by zebgop-ops/qwen38-flashnext-pp); make_mtp_int4.py + Dockerfiles MIT. Patches may not apply to other nightlies (0.29.1rc1.dev47+gdc36fcce9). Perf numbers are the author's, warm, measured through llama-swap, ranges in notes - submitter T0 only, no measured/benchmark flags (no run file). MTP-3 + PP-on-2x170HX findings match the site's other 170HX recipes; BF16 KV + PLE-from-NVMe are the distinguishing features. NOTE for future watch pins: Minachist HF repo + minamism articles are upstream-of-upstream - optional future pins, not auto-added (card item h)." +kv_pool_tokens: 1800000 +storage_requirements: + ram_gb: 64.0