Cover image

Retrieval Changes the Exposure List, Not Just the Score

TL;DR for operators Adding retrieval to an LLM does not necessarily make previously extractable training text inaccessible. A controlled study finds that some continuations remain exposed across different retrieved contexts, others become less extractable, and some become newly exposed.1 Longer prefixes make exposure particularly stable. For teams evaluating retrieval-augmented generation (RAG), an improved aggregate extraction score is therefore incomplete evidence of privacy protection. Test the same target continuations with and without retrieved documents, and track persistent, suppressed, and newly enabled exposures. Include longer prefixes, multiple retrieval contexts, and realistic prompt formatting. ...

November 13, 2026 · 8 min · Zelina
Cover image

Give the Generator Less to Leak: KFS-RAG Moves Privacy to the Retrieval Boundary

TL;DR for operators An enterprise assistant may retrieve a long internal document because one sentence is relevant to a user question. If the entire passage is then handed to the generator, the model receives much more information than it needs—and a successful prompt injection has more material available to disclose. KFS-RAG addresses that exposure point after retrieval but before generation. Instead of forwarding raw passages, it identifies query-relevant evidence and converts it into a compact set of facts. In the paper’s open-domain QA evaluation, this reduced untargeted chunk recovery from 70.8% with Vanilla RAG to 21.03%, while answer BLEU-1 and ROUGE-L remained close to the raw-context baseline. ...

September 22, 2026 · 8 min · Zelina
Cover image

When Models Learn to Forget: Why Memorization Isn’t the Same as Intelligence

A contract clause appears in a chatbot response. Not a summary. Not a paraphrase. The clause itself, with the same odd phrasing, the same punctuation, and the same mildly embarrassing typo that legal counsel thought nobody outside the company would ever see. The model did not “reason” its way there. It remembered. ...

December 26, 2025 · 15 min · Zelina
Cover image

The Sink That Remembers: Solving LLM Memorization Without Forgetting Everything Else

TL;DR for operators Deletion is simple in a database. It is not simple in a neural network that has already used the deleted record to improve its internal machinery. That is the unpleasant little invoice this paper presents. Gaurav R. Ghosal, Pratyush Maini, and Aditi Raghunathan study why repeated natural text is hard to remove from language models after training, then propose MemSinks, a training-time mechanism designed to make memorization easier to isolate later.1 The important shift is not “better pruning.” It is architectural accounting. Instead of hoping that memorized text happens to live in a few removable neurons, MemSinks gives repeated sequences a controlled place to accumulate memorization during training. ...

July 15, 2025 · 19 min · Zelina