97.99% Retained Is Not 97.99% Done: KnowBench Measures Clinical AI by What Clinicians Keep
TL;DR for operators Kang and Zhang’s KnowBench: Effort Reduction as a Unified, Deployment-Grounded Benchmark for Clinical AI1 starts from a practical question: after a clinical AI system generates work, how much of that work does the responsible clinician actually keep? For documentation, the reported answer is striking. Across more than one million signed encounters, more than six contiguous months, and thirteen specialties, 97.99% of generated content was retained on a content-weighted basis. But that number is not 97.99% factual accuracy, and it does not establish that 97.99% of the clinician’s documentation effort disappeared. ...