Scalpels Not Sledgehammers: A New Era of Precision Editing for LLMs
TL;DR for operators Large language models age badly. Product names change, policies expire, executives move, medical or legal guidance becomes stale, and some facts in pre-training were never right in the first place. The usual repair options are clumsy: retrain the model, fine-tune it, hide updated facts in prompts, or bolt on retrieval and hope the model behaves. All useful. All annoying in different ways. ...