Safety Testing

Test lab. That phrase still sounds reassuring: white floors, controlled equipment, engineers with clipboards, a vehicle behaving badly in exactly the way the test protocol expected. Very scientific. Very orderly. Very unlike the road. Autonomous vehicles do not fail only inside tidy scenarios. They fail in combinations: glare plus wet pavement, partial occlusion plus a distracted pedestrian, sensor ambiguity plus a planner that is technically following its objective but not the spirit of survival. The industry’s safety problem is therefore not merely “we need more tests.” It is more awkward than that. We need better ways to search for the tests humans did not think to write. ...

TL;DR for operators AGENTS-LLM is not another attempt to make a language model dream up an entire traffic world and then hope the simulator forgives the hallucination. It does something narrower and more operationally useful: it takes an existing real-world driving scenario, accepts a natural-language instruction such as adding a parked vehicle, jaywalker, accident site, or construction zone, and produces an augmented scenario that can be executed in closed-loop autonomous-driving simulation.1 ...