DeepSeek V4.1 Flash shrinks KV cache to 890 bytes/token, cutting agent memory costs 4x

DeepSeek released V4.1 Flash, a 552-billion-parameter multimodal Mixture-of-Experts model that activates only 8B parameters at prefill and 16B at decode, paired with a redesigned Causal Encoder-Decoder architecture that shrinks the global KV cache to 890 bytes per token — roughly one-quarter of V4-Flash's footprint. That 4x memory reduction is the headline: it lets far more concurrent agent sessions fit per GPU and cuts cache-read pricing by up to 57% ($0.006 vs $0.014 per MTok). The model ships under the MIT license with a 1M-token context window, allowing self-hosting and commercial use.

The economics are the story. For agentic workloads that keep long contexts alive across many turns, KV cache is the dominant memory cost, and a 4x reduction directly translates to more sessions per GPU and lower per-token inference bills. DeepSeek also claims V4.1 Flash outperforms OpenAI's GPT-5.6 Sol and Anthropic's Claude Opus-5.0 on several agentic coding benchmarks — an aggressive positioning that pairs frontier-ish quality with open weights and radically cheaper serving.

NVIDIA underscored the momentum by publishing a 4-bit NVFP4 version tuned for Blackwell GB300 GPUs, supporting the full 1M-token context with accuracy shifting no more than 1.5 points across six benchmarks, also under MIT license — a notable signal that the hardware vendor is optimizing for a Chinese open model.

Community enthusiasm was strong: r/DeepSeek developers reported canceling Claude and Codex subscriptions, with one noting '$10 gives you ~2B tokens for a month of usage.' Skeptics flagged quality trade-offs on harder reasoning tasks and cautioned that benchmark wins don't always survive real-world agentic use. Still, the 890-byte cache was widely called 'the agentic infrastructure play nobody expected.'