Conversational AI

TL;DR for operators Dinner plans are where elegant recommender theory goes to be quietly embarrassed. Five people do not usually open a dedicated app, rate every restaurant, agree on a utility function, and wait for a ranked list to descend from the heavens. They argue in a chat. They change their minds. Someone forgets the budget. Someone says “anything is fine” while absolutely not meaning it. Someone else proposes a venue that is closed on Mondays. Humanity, as usual, remains a hostile runtime environment. ...

TL;DR for operators Long-context windows are useful. They are also an expensive way to pretend that memory is just a bigger clipboard. The HEMA paper argues for a more operationally realistic design: keep a compressed summary of the conversation always visible, store detailed past exchanges outside the prompt, and retrieve only the details that matter for the current turn.1 That gives the model two different memory behaviours: continuity from Compact Memory and factual recall from Vector Memory. ...