AI Governance

Opening — Why this matters now Everyone wants “agentic AI.” Few are prepared to train it properly. As large language models evolve into tool-using, multi-step decision makers, the bottleneck is no longer raw model scale. It is environment scale. Real-world reinforcement learning (RL) for agents is expensive, fragile, and rarely reproducible. Public benchmarks contain only a handful of environments. Real APIs throttle you. Human-crafted simulations do not scale. ...

Opening — Why this matters now Large language models are no longer judged by whether they work, but by whether we can trust how they work. In regulated domains—finance, law, healthcare—the question is no longer abstract. It is operational. And increasingly uncomfortable. The paper behind this article tackles an issue the industry prefers to wave away with scale and benchmarks: memorization. Not the vague, hand-wavy version often dismissed as harmless, but a specific, measurable phenomenon that quietly undermines claims of generalization, privacy, and robustness. ...

Opening — Why this matters now Explainable AI has always promised clarity. For years, that promise was delivered—at least partially—through feature attributions, saliency maps, and tidy bar charts explaining why a model predicted this instead of that. Then AI stopped predicting and started acting. Tool-using agents now book flights, browse the web, recover from errors, and occasionally fail in slow, complicated, deeply inconvenient ways. When that happens, nobody asks which token mattered most. They ask: where did the agent go wrong—and how did it get there? ...

Opening — Why this matters now AI agents are no longer toy demos. They write production code, refactor legacy systems, navigate websites, and increasingly make decisions that matter. Yet one deceptively simple question remains unresolved: can an AI agent reliably tell whether it will succeed? This paper delivers an uncomfortable answer. Across frontier models and evaluation regimes, agents are systematically overconfident about their own success—often dramatically so. As organizations push toward longer-horizon autonomy, this blind spot becomes not just an academic curiosity, but a deployment risk. ...

Opening — Why this matters now Alignment used to be a single‑model problem. Train the model well, filter the data, tune the reward, and call it a day. That framing quietly breaks the moment large language models stop acting alone. As LLMs increasingly operate as populations—running accounts, agents, bots, and copilots that interact, compete, and imitate—alignment becomes a system‑level phenomenon. Even perfectly aligned individual models can collectively drift into outcomes no one explicitly asked for. ...

Opening — Why this matters now Federated learning was supposed to be the grown-up solution to privacy anxiety: train models collaboratively, keep data local, and everyone sleeps better at night. Then reality arrived. Real devices are heterogeneous. Real data are wildly Non-IID. And once differential privacy (DP) enters the room—armed with clipping and Gaussian noise—training dynamics start to wobble like a poorly calibrated seismograph. ...

Opening — Why this matters now Prompt injection used to be treated as a craft problem: clever wording, social engineering instincts, and a lot of trial and error. That framing is now obsolete. As LLMs graduate from chatbots into agents that read emails, browse documents, and execute tool calls, prompt injection has quietly become one of the most structurally dangerous failure modes in applied AI. ...

Opening — Why this matters now AI models are now fluent in contest math, symbolic manipulation, and polished explanations. That’s the easy part. The harder question—the one that actually matters for science—is whether these systems can do research when the answer is not already in the training set. The paper First Proof arrives as a deliberately uncomfortable experiment: ten genuine research-level mathematics questions, all solved by humans, none previously public, and all temporarily withheld from the internet. ...

Opening — Why this matters now Security teams are being asked to do more with less, while the attack surface keeps expanding and adversaries automate faster than defenders. Large language models promise relief: summarize logs, suggest response actions, even draft incident playbooks. But there’s a catch that every practitioner already knows—LLMs are confident liars. In security operations, a hallucinated action isn’t just embarrassing; it’s operationally expensive. ...

Opening — Why this matters now Medical AI is no longer struggling with accuracy. In constrained tasks like MRI-based brain tumour detection, convolutional neural networks routinely cross the 90% mark. The real bottleneck has shifted elsewhere: trust. When an algorithm flags—or misses—a tumour, clinicians want to know why. And increasingly, a single colourful heatmap is not enough. ...