Forgetting by Design: Turning GDPR into a Systems Problem for LLMs
TL;DR for operators A deletion request is not a prompt. It is not a “please forget” instruction, a fine-tuning vibe, or a compliance-flavoured model apology. The useful idea in Unlearning at Scale: Implementing the Right to be Forgotten in Large Language Models is much less mystical: make training reproducible enough that deletion can be executed like systems recovery.1 The paper treats training as a deterministic program, logs the minimal control inputs needed to replay that program, and then removes the requested data during replay. Under strict preconditions, the resulting parameters are bit-identical, in the training dtype, to the model that would have been produced if the forgotten examples had never been included. ...