LLM Memorization on Cognaptus

LLM Memorization on Cognaptus https://cognaptus.com/tags/llm-memorization/ Recent content in LLM Memorization on Cognaptus Hugo -- 0.145.0 en-us Tue, 15 Jul 2025 00:00:00 +0000 The Sink That Remembers: Solving LLM Memorization Without Forgetting Everything Else https://cognaptus.com/blog/2025-07-15-the-sink-that-remembers-solving-llm-memorization-without-forgetting-everything-else/ Tue, 15 Jul 2025 00:00:00 +0000 https://cognaptus.com/blog/2025-07-15-the-sink-that-remembers-solving-llm-memorization-without-forgetting-everything-else/ A mechanism-first reading of MemSinks, a training-time approach for separating useful generalization from removable verbatim memorization in language models. What LLMs Remember—and Why: Unpacking the Entropy-Memorization Law https://cognaptus.com/blog/2025-07-13-what-llms-rememberand-why-unpacking-the-entropymemorization-law/ Sun, 13 Jul 2025 00:00:00 +0000 https://cognaptus.com/blog/2025-07-13-what-llms-rememberand-why-unpacking-the-entropymemorization-law/ A mechanism-first reading of how set-level entropy turns noisy memorization anecdotes into a practical audit signal for LLM training data.