Retrieval Changes the Exposure List, Not Just the Score
TL;DR for operators Adding retrieval to an LLM does not necessarily make previously extractable training text inaccessible. A controlled study finds that some continuations remain exposed across different retrieved contexts, others become less extractable, and some become newly exposed.1 Longer prefixes make exposure particularly stable. For teams evaluating retrieval-augmented generation (RAG), an improved aggregate extraction score is therefore incomplete evidence of privacy protection. Test the same target continuations with and without retrieved documents, and track persistent, suppressed, and newly enabled exposures. Include longer prefixes, multiple retrieval contexts, and realistic prompt formatting. ...