Gemma 4 reproducibly emits three sequential outputs — including a self-disclaimer — in one response

A dev.to write-up by 'thehwang' published May 20 documents a reproducible behavior in Google's Gemma 4 E2B that's now circulating in open-model communities. With deterministic settings — num_ctx=2048 and temperature=0.0 — Gemma 4 E2B emits three sequential outputs per single response when asked to summarize: a confident summary that contains hallucinations, an explicit 'Note:' paragraph in which the model disclaims the prior summary's accuracy, and then a more careful retry. The same prompt on other E-class models in the same context envelope doesn't reproduce the pattern.

The finding is small but interesting for two reasons. First, it's deterministic — at temperature 0.0 the behavior is consistent across runs, which rules out sampling noise and points at training-data or RLHF-stage artifacts baked into Gemma 4's behavior. Second, the model is essentially self-correcting mid-response without being prompted to, suggesting an internal 'critic' signal that fires after generation completes the first draft. That's the kind of inner-monologue pattern usually engineered explicitly via chain-of-thought scaffolding — observing it as an emergent quirk in an open-weights model is a useful research artifact.

The context: Google's I/O week leaned hard on Gemini at the frontier, but Gemma remains its open-weights story for researchers and on-device developers. Quirks like this one tend to drive open-source community engagement — Hugging Face's Clement Delangue's social posts this week explicitly celebrated open-weight model accessibility — and they also feed into the broader hallucination-detection literature.

What to watch: whether Google's Gemma team patches this in a point release or documents it as expected behavior, and whether anyone reproduces a similar pattern in larger Gemma 4 sizes. The dev.to post is small-circulation but the type of finding that gets picked up by r/LocalLLaMA — where Qwen, DeepSeek, and Gemma comparison threads are running hot this week.