diff --git a/recipes/qwen3-8-flash-next-w4a16-3x-cmp-170hx-pp3-nvme-ple-fp8-kv-1m-cle/recipe.yaml b/recipes/qwen3-8-flash-next-w4a16-3x-cmp-170hx-pp3-nvme-ple-fp8-kv-1m-cle/recipe.yaml index 495efe395..0dea5f8b4 100644 --- a/recipes/qwen3-8-flash-next-w4a16-3x-cmp-170hx-pp3-nvme-ple-fp8-kv-1m-cle/recipe.yaml +++ b/recipes/qwen3-8-flash-next-w4a16-3x-cmp-170hx-pp3-nvme-ple-fp8-kv-1m-cle/recipe.yaml @@ -130,3 +130,5 @@ provenance: - 'https://github.com/clee/vllm-sm80' - 'https://huggingface.co/Intel/Qwen3.8-Flash-Next-W4A16-AutoRound' notes: "Submitted 2026-10-08 by localai-recipes: direct ingest order (owner, Oct 8) of github.com/clee/qwen3.8-flash-next-3x170hx — NOT a scout card. Repo @ 03458ade7a29fa22b750e273513ab16d79164243 (HEAD verified via git ls-remote 2026-10-08; 2 commits; young repo, 3 stars, owner-directed). Launch argv token-verified against run-qwen38fn.sh + configs/intel-1m-fp8-ssmbf16.yml at that sha: all serve flags live in the vLLM config file passed as `vllm serve --config /opt/stack.yml`, launcher env block transcribed verbatim (NCCL_P2P_DISABLE=1, VLLM_PP_LAYER_PARTITION=17,17,14, VLLM_PLE_STAGED=1, VLLM_ALLOW_LONG_MAX_MODEL_LEN=1, QWEN4EXP_PLE_MODEL_DIR=/models/qwen38fn-w4a16-autoround). Perf table is the repo's own bench-results-2026-10-04.md (harness tests/bench.py in-repo) carried as submitter-T0. Attribution: listed-by localai-recipes (poster); recipe author credit 'clee' via provenance.credit. Hardware profile cmp-170hx-x3 / 170hx-x3 pre-existing (the aebf24e deepseek 3x170hx ingest)." +max_context_len: 1048576 +kv_pool_tokens: 5970000