The Cost of Remembering Every Possible Answer
TL;DR for operators An agent must often retain information before knowing which question it will need to answer later. Compressing that information reduces immediate storage, but some answers may then require access to an archived record. The relevant costs include retained state, archive storage, retrieval width, decoding latency, and the questions the representation can still answer. ...