DeepSeek V4.1-Flash Achieves 890-Byte KV Cache per Token, 437x Smaller Than V1

DeepSeek's V4.1-Flash targets the single biggest bottleneck in agentic deployment: memory. By cutting the KV cache to 890 bytes per token — a quarter of V4-Flash's footprint and 437x smaller than V1 — the model enables roughly 4x more concurrent agent sessions on the same GPU. For agent economics, that is a step-change: the cost of running many parallel, long-running agent sessions is dominated by memory, and a 4x density improvement directly resets the per-session cost curve.

The architecture, per a comparison benchmark, is built on a causal encoder-decoder MoE with a 552B backbone plus 196B active parameters (V4.1 Flash), released September 10. Developers were thrilled — the paper became the most-upvoted of the day at 131 upvotes with 3,412 Hugging Face likes, with the community calling the KV-cache reduction 'a practical reset of agent economics.'

DeepSeek also demonstrated responsiveness to its user base, reversing the planned retirement of V4-Pro within days after backlash. On the hardware front, the company plans to deploy 160,000 Huawei Ascend 950DT chips in Inner Mongolia, with training chips expected by Q4 2026 — a signal of its push toward domestic-silicon independence amid export controls. The efficiency focus dovetails with a broader DeepSeek strategy of doing more with less, positioning its models as the cost-efficiency leader in a market where OpenAI is projecting $856B in compute spend. The open question is whether the aggressive KV-cache compression sacrifices quality on long-context reasoning tasks — the kind of tradeoff that benchmark headlines rarely capture but production deployments quickly expose.