A Memory Worth Keeping Must Survive the Next Conversation
TL;DR for operators An AI assistant can remember an accurate customer preference and still use it incorrectly. The relevant storage decision is whether that memory will improve appropriate future interactions without contaminating unrelated requests or crossing contextual boundaries. ConMem evaluates candidate memories through three simulated future interactions, comparing responses with and without memory access. On its 1,079-case MemAlign benchmark, it achieves 75.16% admission accuracy and 65.31% Macro-F1, outperforming four evaluated baselines on both metrics. Yet it rejects only 39.33% of memories labeled Do-Not-Store. MemoryBank achieves higher balanced accuracy and substantially better rejection recall. ...