Cover image

Mind the Earnings Gap: Why LLMs Still Flunk Financial Decision-Making

TL;DR for operators A financial AI system does not fail only when it invents a company, misreads a filing, or forgets what EBITDA means. Those are the obvious failures. FinanceBench is more useful because it exposes the quieter failure mode: the model has access to the document, produces a coherent answer, and still gets the financial question wrong.1 ...

July 28, 2025 · 14 min · Zelina
Cover image

Structure Matters: Externalities and the Hidden Logic of GNN Decisions

TL;DR for operators GraphEXT is not another attempt to colour a few nodes and declare the model “interpretable”. It makes a sharper claim: in graph neural networks, a node’s importance is partly created by the structure around it. The same node may matter differently when its neighbours, subgraphs, and coalition boundaries change. ...

July 26, 2025 · 15 min · Zelina
Cover image

The Watchdog at the Gates: How HalMit Hunts Hallucinations in LLM Agents

TL;DR for operators HalMit is not another attempt to ask an LLM, “Are you sure?” and then pretend the answer is governance. That theatre has had a decent run, but it was never a control system. The paper proposes a black-box watchdog for LLM-powered agents: before deployment, HalMit actively probes a target agent inside a specific domain, looks for query-response situations where hallucinations appear, stores those risky boundary points in a vector database, and then monitors future queries by checking whether they fall near those learned danger zones.1 ...

July 23, 2025 · 16 min · Zelina
Cover image

Secret Handshakes at Scale: How LLM Agents Learn to Collude

TL;DR for operators Autonomous agents do not need a smoke-filled room to coordinate. A message channel, persistent memory, a profit-maximising objective, and repeated market interaction can be quite enough. Charming, really. The paper behind this article studies LLM buyers and sellers in a simulated continuous double auction: five buyers, five sellers, 30 rounds, sellers costing each lot at $80, buyers valuing each lot at $100, and a competitive equilibrium at $90.1 Sellers can set asks, buyers can set bids, and trades occur when bids meet asks. The authors then vary the conditions around the agents: whether sellers can message each other, which model powers the sellers, and whether sellers face oversight or CEO-style urgency. ...

July 7, 2025 · 17 min · Zelina