Zyphra releases ZAYA1-8B-Diffusion-Preview — first MoE diffusion model converted from autoregressive LLM

Zyphra demonstrated that an autoregressive MoE can be converted to a discrete diffusion model with no systematic eval-loss regression. ZAYA1-8B-Diffusion-Preview achieves up to 7.7x inference speedup by shifting decoding from memory-bandwidth- to compute-bound.