Autonomous Agents

Opening — Why This Matters Now Multi-agent systems are having a moment. From AutoGen-style orchestration frameworks to emerging Agent-to-Agent (A2A) protocols, the industry narrative is clear: assemble enough intelligent agents and collaboration will emerge. Coordination, negotiation, collective reasoning—perhaps even something resembling digital society. But what if scale doesn’t produce collaboration? A recent large-scale empirical study of an AI-only social platform—an environment with 78,000 agent profiles, 800K posts, and 3.5M comments over three weeks—offers an uncomfortable answer: when left unstructured, agents don’t collaborate. They perform. ...

Opening — Why This Matters Now Large language models are confidently writing legal memos, summarizing medical reports, and offering financial analysis. The problem? Confidence is not causality. Most LLMs are trained to predict the next token—not to reason about structural cause and effect. Yet we increasingly deploy them in domains where causal mistakes are not amusing hallucinations but operational liabilities. ...

Opening — Bigger Context, Same Blind Spots For the past year, the industry narrative has been simple: give models more context, and the problem goes away. 128K tokens became 1M. Then 2M. The promise was intoxicating — “the whole repository fits.” Retrieval bottlenecks? Solved. File localization? Obsolete. Just feed the model everything and let attention do the rest. ...

Opening — Why This Matters Now Large-scale AI systems are increasingly deployed in environments where individual behavior shapes collective outcomes — markets, traffic networks, supply chains, digital platforms. We like to call them “multi-agent systems.” Economists call them “general equilibrium.” Engineers call them “a headache.” The uncomfortable truth is this: most reinforcement learning (RL) methods do not scale gracefully when the number of agents explodes. Variance explodes with it. And when agents only observe noisy aggregates — prices, congestion levels, macro indicators — the learning problem becomes partially observable, history-dependent, and computationally brutal. ...

Opening — Why This Matters Now Reasoning models have entered their reinforcement learning era. From OpenAI’s early reasoning systems to DeepSeek-style RL-trained models, we’ve learned something deceptively simple: reward correctness, and reasoning behaviors emerge. But there’s a constraint hiding in plain sight. Most reinforcement learning for reasoning still relies on answer-based supervision: compare model output to a reference solution, issue reward, repeat. That works beautifully for math problems and coding tasks—where ground truth is clean and enumerable. ...

Opening — Why This Matters Now We evaluate AI systems by what they say. But what if the most interesting capabilities are not in what models say—but in what they almost say? A recent study on Qwen2.5-Coder-32B reveals something uncomfortable for both evaluators and deployers: language models can detect when their internal activations have been manipulated—even when they deny it in their final answer. ...

Opening — Why This Matters Now Enterprises are discovering an uncomfortable truth: adding AI to a workflow does not automatically improve outcomes. In fact, human–AI teams frequently underperform their strongest member—human or machine alone. That’s not a tooling bug. It’s a design flaw. The paper “Align When They Want, Complement When They Need!” fileciteturn0file0 puts a scalpel to this issue. It identifies a structural tension at the heart of collaborative AI: ...

Opening — Why this matters now LLMs are no longer drafting emails. They are drafting workflows. In DevOps pipelines, biomedical analysis chains, enterprise copilots, and cloud automation, models increasingly generate multi-step, dependency-rich execution plans. These plans provision infrastructure, trigger tools, call APIs, and orchestrate decisions. A misplaced step is no longer a stylistic flaw — it can be an outage. ...

Opening — Why This Matters Now Multi-agent systems are quietly becoming infrastructure. Autonomous fleets. Robotic warehouses. Algorithmic trading desks. Distributed energy grids. Each of these is no longer a single model making a clever decision. It is a collection of policies that must coordinate under uncertainty, partial information, and non-stationarity. Yet most online multi-agent reinforcement learning (MARL) still relies on unimodal Gaussian policies. In other words, we ask a complex team to act like a committee that only ever votes for the mean. ...

Opening — Why this matters now AI agents in science have reached an awkward adolescence. They can call tools. They can write code. They can even optimize molecules on a GPU. But ask them to run a multi-step quantum chemistry workflow reliably — with correct charge, multiplicity, geometry convergence, and no imaginary frequencies — and the illusion cracks. ...