Cover image

When Another Training Round Stops Buying Learning

TL;DR for operators Closed-loop self-training should not be treated as productive merely because the system is still generating examples and updating weights. Wang et al. propose measuring whether each new round contains patterns that were not already predictable from the previous round, then using that signal to decide both which samples deserve gradient weight and whether another round is worth running at all.1 ...

October 14, 2026 · 8 min · Zelina
Cover image

Model Cannibalism: When LLMs Learn From Their Own Echo

Feedback is usually sold as the civilized part of AI deployment. Users interact with the model. The product team collects prompts, outputs, ratings, usage logs, corrections, maybe a few thumbs-up signals. The model is fine-tuned. The next version is better. Everybody nods. A dashboard is opened. Someone says “continuous improvement.” The room relaxes. ...

January 9, 2026 · 19 min · Zelina
Cover image

Collapse to Forget: Turning Model Collapse into a Privacy Feature for LLMs

TL;DR for operators When an LLM leaks sensitive, copyrighted, or otherwise forbidden information, the obvious repair is to fine-tune it away from the bad answer. That sounds sensible until you notice the small operational comedy: the remediation process keeps using the very answer it is supposed to remove. The paper behind this article proposes Partial Model Collapse (PMC), a machine unlearning method that avoids directly optimising on ground-truth forget answers. Instead, PMC asks the model the sensitive question, samples multiple responses from the model itself, selects a response that is less like the model’s original answer, and fine-tunes on that self-generated response while also training on retain data to preserve general utility.1 ...

July 8, 2025 · 16 min · Zelina