The Lab's Next Move Is the Hard Part
TL;DR for operators An AI assistant can recognize laboratory equipment, explain chemical principles, and recommend a familiar procedure while still making the wrong decision for the sample in front of it. LabOPBench evaluates this problem using 756 expert-authored laboratory decision questions. Eight multimodal models achieved normalized rubric scores between 28.8% and 45.8%, with postprocessing averaging just 34.9% across models. These percentages measure accumulated rubric points, not the proportion of fully correct answers. ...