Cover image

A Reliable Alarm Can Still Miss the Drift

TL;DR for operators A building’s heating controller may pass its original assurance checks, then lose effectiveness during operation. Can a runtime monitor detect that change? In the paper’s simulated Building benchmark with 8% heating loss, spatial monitoring raised alarms in all 50 runs (median delay: 3,043 observations), while uniform and temporal monitoring raised none. All three used paired trajectories and the same 5% false-alarm tolerance. A reliable alarm rule is not necessarily a sensitive detector. ...

November 11, 2026 · 9 min · Zelina
Cover image

The Verdict Is Not the Evidence

TL;DR for operators In Beyond QASecClaw: Agent Scaling, Verifier Feedback, and Evidence Reliability in Software Assurance1, additional LLM assessment contexts did not consistently make defect-clearance decisions safer. Scaling from one to 50 contexts increased token consumption approximately 49-fold on eight authored Java warning controls without meaningfully reducing unsafe clearance. Raw formal-verifier feedback improved correct assertion verdicts but also increased incorrect ones. More surprisingly, models frequently rejected valid counterexamples that correctly demonstrated program defects. ...

November 11, 2026 · 10 min · Zelina
Cover image

The Transition You Never Saw Still Matters

TL;DR for operators A controller can repeatedly complete its assigned task in simulation without providing a mathematical guarantee that it will eventually succeed. For an unknown decision system, increasing the simulation budget does not always close that gap. S Akshay, Suguman Bansal, and Gaurav Mahla1 prove that learning or verifying an almost-sure reachability certificate has no uniform sample-complexity guarantee when unknown transition probabilities are unrestricted. An arbitrarily rare transition can remain invisible under any sample budget determined only by model size and confidence. ...

November 10, 2026 · 8 min · Zelina
Cover image

The Safety Shield That Must Account for Its Risk

TL;DR for operators An autonomous agent can improve its task performance by taking actions that increase the probability of violating an operating constraint. RecReg addresses this through a separate recovery policy and an action-level shield that evaluates future violation risk before allowing an action to execute. The framework offers conditional mathematical safety guarantees in finite tabular environments, plus simulated evidence of reduced violations in deep reinforcement learning. In SafetyGym PointGoal1, its deep implementation reduces the reported violation rate from 0.0562 to 0.00500 relative to unconstrained DreamerV3, while average task return falls from 22.2 to 17.3. ...

November 9, 2026 · 9 min · Zelina
Cover image

Verified Is Not Authorized: How Agent Guardrails Earn the Right to Act

TL;DR for operators An agent guardrail that learns from incidents must solve three different problems: produce a better rule, verify that the rule is executable and internally consistent, and establish enough evidence to let it control real actions. VEPA separates these responsibilities. An LLM proposes policy changes, a deterministic verifier rejects malformed or conflicting rules, and a Bayesian authority mechanism determines which verified rules may actively allow or refuse agent actions. ...

October 28, 2026 · 8 min · Zelina
Cover image

The LLM Is Not the Converter

TL;DR for operators An engineering team migrating behavior logic between control architectures has two separate problems: understanding what an existing specification means, and reproducing that behavior without losing a branch, loop, transition, or termination condition. Automating the first problem is relatively easy to imagine. Trusting automation with the second is harder because a plausible-looking conversion can still change executable behavior. ...

October 14, 2026 · 7 min · Zelina
Cover image

Verify the Contract Before You Verify the Work

TL;DR for operators A deterministic verifier can tell you whether an artifact satisfies a formal specification. It cannot tell you whether that specification faithfully represents what the user originally asked for. Magenta makes this distinction explicit. The system first converts a natural-language mathematics problem and proposed answer into a Lean statement, then uses a learned judge to check whether that statement preserves the intended problem before attempting a machine-checked proof. When proof verification fails, another judge classifies the failure as mathematical or formal-implementation related and sends the next correction to the corresponding component.1 ...

October 2, 2026 · 8 min · Zelina
Cover image

A Proof Can Pass and Still Mean the Wrong Thing: What AxQM Changes About Formal AI Evaluation

TL;DR for operators When an AI system produces a formal proof, an evaluation team can make one part of the verdict unusually objective: either the proof is accepted under the allowed rules, or it is not. That removes much of the grader variance found in rubric scoring or LLM judging. AxQM provides 1,019 Lean 4 proof-synthesis tasks over 479 finite-dimensional quantum-mechanics textbook items. It keeps a private reference solution for every task and grades submissions through successful compilation, absence of sorry in the proof or its dependencies, and absence of newly introduced axioms.1 ...

September 22, 2026 · 6 min · Zelina
Cover image

The Right Answer Is Not a Proof: Put Verification Inside the Reasoning Loop

TL;DR for operators A model can produce a correct answer while taking a logically invalid route to get there. That distinction matters whenever downstream execution depends not only on the answer, but on whether the intermediate decisions are trustworthy. Chen, Zhou, and Zhang test a lighter alternative to full theorem-proof generation: PRoSFI, which asks a 7B model to expose small, machine-readable reasoning steps that external formal tools can verify.1 On ProverQA-Hard, outcome-only reinforcement learning reaches 91.31% answer accuracy but only 21.97% GPT Soundness. PRoSFI reaches 92.97% accuracy and 76.07% GPT Soundness. The practical lesson is not that every business workflow should be formalized. It is that when intermediate decisions can be expressed as checkable rules, adding a verification layer can provide a stronger reliability signal than final-answer accuracy alone. ...

September 18, 2026 · 7 min · Zelina
Cover image

Policy Is Not Proof: What Machine-Checked Declassification Changes for Security Teams

TL;DR for operators When software is intentionally allowed to disclose some sensitive information, a release rule and proof of compliance should not be the same object. David A. Naumann’s Assuming You Knew: Fixing an Epistemic Semantics for Flow Policies Using Agentic AI1 repairs an earlier framework by giving permitted information release an explicit meaning, then separately defining whether an observer learned more than that policy allows. ...

August 24, 2026 · 7 min · Zelina