Mind the Interface: Tiny Models, Big Trust, and Why AI Must Own Its Mistakes
TL;DR for operators Small models are not necessarily as incapable as their standard evaluations make them look. On bounded tasks, the wrong training and scoring interface can conceal useful capability. A correct retraction is not necessarily a successful recovery. Users may accept the correction while losing confidence in the agent that created the problem. The two papers imply a full-stack rule: train the system through the interface that matches the decision, then repair errors through the agent that owns the relationship. Backend specialization and frontend continuity are compatible. An expert model can verify the correction, but the original user-facing agent should acknowledge and communicate it. Evaluation should measure both sides of reliability: whether the system gets the decision right and what happens to user trust when it does not. The model is not the whole system AI deployment discussions still have an unfortunate habit of treating model capability as if it were a fluid stored inside a parameter tank. Larger tank, more intelligence. Smaller tank, less intelligence. Procurement can then proceed by comparing benchmark columns and invoices. ...