diff --git a/recipes/deepseek-v4-1-flash-exl3-3bpw-tc-moe-on-4x-cmp-170hx-tp4/recipe.yaml b/recipes/deepseek-v4-1-flash-exl3-3bpw-tc-moe-on-4x-cmp-170hx-tp4/recipe.yaml index 61b390ddf..f608f4255 100644 --- a/recipes/deepseek-v4-1-flash-exl3-3bpw-tc-moe-on-4x-cmp-170hx-tp4/recipe.yaml +++ b/recipes/deepseek-v4-1-flash-exl3-3bpw-tc-moe-on-4x-cmp-170hx-tp4/recipe.yaml @@ -170,4 +170,3 @@ provenance: - 'https://github.com/Morrowmake/vllm-cmp170hx' - 'https://huggingface.co/Mia-AiLab/DeepSeek-V4.1-Flash-EXL3-3.0bpw' notes: "Scouted + ingested by localai-recipes from the CurtisAccelerate repo (created 2026-10-17); recipe, port and measurements by Curtis White. Tensor-core EXL3 MoE kernels + host-staged all-reduce ported from Morrowmake/vllm-cmp170hx @ 18305948 (Apache-2.0; built for Qwen3.8-Flash-Next on 2x CMP 170HX). EXL3 codec adapted from turboderp exllamav3 @ d3739fd3 (MIT). Checkpoint Mia-AiLab/DeepSeek-V4.1-Flash-EXL3-3.0bpw @ c5534b90 (MIT; base deepseek-ai/DeepSeek-V4.1-Flash; 40 layers, hidden 5120, 384 experts top-6, MTP). Morrowmake's published CMP 170HX tables are for hardware-class comparability on a different model, not a head-to-head. All performance numbers author-reported (T0)." -max_context_len: 262144