How Many Passes Does an AI Decision Need?
TL;DR for operators An automated decision service may benefit from reconsidering a question before selecting an answer. But additional computation has a cost, and a more confident answer is not necessarily more trustworthy. SanSi demonstrates a configurable approach: repeatedly process the same input through shared transformer layers and produce option probabilities after each pass. Across its evaluation suite, accuracy improves substantially within three loops, with much smaller gains thereafter. Eight loops achieve 72.0% accuracy but cost 7.7 times the GPU computation of a one-loop Ouro pass. Probability calibration also deteriorates after the third loop. ...