The Confidence Model You May Already Have
TL;DR for operators A team has improved its reasoning model through reinforcement learning and now needs confidence scores to decide which answers to accept, review, or compare. Training another estimator adds work. Training confidence directly into the model can also change its original performance. Wu and Ji show that some reinforcement-learning systems may already contain the necessary prediction capability. Their Critic-as-Confidence (CaC) method reuses an existing value network to estimate answer correctness, without additional confidence-specific training or modifying the generating model.1 ...