Abstraction

Templates are usually sold as a convenience feature. Save time. Avoid repetition. Make the next task faster. That is not wrong. It is just a little shallow, which is how many productivity slogans prefer to travel. A better way to think about a template, helper function, saved workflow, reusable prompt, or internal operating procedure is this: it changes the search space. It does not merely shorten the final sequence of actions. It changes what counts as an available move. ...

A warehouse robot does not always need elegance. In an open aisle, “move forward a bit” is probably good enough. Near a shelf, a wall, or a human ankle, “a bit” becomes an expensive philosophy. That is the practical problem behind Context-Sensitive Abstractions for Reinforcement Learning with Parameterized Actions, the paper introducing PEARL: Parameterized Extended state/action Abstractions for Reinforcement Learning.1 The paper is not really about making reinforcement learning more fashionable. Mercifully. It is about making action precision conditional. ...