Cover image

Jerk Matters: Teaching Reinforcement Learning Some Mechanical Manners

A thermostat can be annoying in a very ordinary way. It does not need to fail dramatically. It only needs to keep switching equipment on and off, chasing tiny temperature deviations as if every small fluctuation were a crisis. The room stays mostly comfortable. The dashboard may even show acceptable performance. But behind the polite control signal, compressors cycle, dampers move, energy bills creep upward, and maintenance teams inherit the consequences. ...

January 6, 2026 · 14 min · Zelina
Cover image

Cool Heads Prevail: Human-in-the-Loop AI for Smarter HVAC Careers

TL;DR for operators HVAC optimisation is not really about “setting the right temperature”. That is the version suitable for brochure copy and mildly insulting procurement decks. The harder problem is deciding when comfort, occupancy, outdoor conditions, and electricity prices should overrule one another. The paper behind this article proposes a human-in-the-loop reinforcement learning controller for HVAC systems.1 Its main idea is simple enough to be useful: when occupants override the system, that feedback should not merely fix the current moment. It should also teach the controller what went wrong, so future decisions require fewer overrides. ...

May 12, 2025 · 16 min · Zelina