Spend the Second Write Where It Pays
TL;DR for operators A continuously updated LLM does not necessarily need to modify its parameters for every new fact. If retrieval already makes an update answerable, the expensive second write may add little. ALLOT, a hybrid-memory routing method from Huang, Fang, Xiao, and Du,1 keeps every factual update in external retrieval memory and ranks updates for additional parametric adaptation. A hard cutoff then assigns the available adaptation budget to only the highest-ranked facts. ...