The Facts Didn't Make It to the Decision
TL;DR for operators An AI team can possess every fact needed for a decision and still reach the wrong conclusion. TeamGym, a benchmark for distributed-information decision-making, reports an average 22.9-percentage-point loss in decision success when necessary facts are distributed among agents instead of given to one agent. Requiring those agents to retrieve the facts from source documents introduces a further 19.9-point loss.1 ...