Rejected, Not Wasted: What Carryover Drafting Recovers
TL;DR for operators When a lightweight model proposes several future tokens, the main model checks them together and rejects those it cannot accept. The rejected tokens cannot be used as output, but verification has already produced internal representations of them. Rejecting a token does not mean every computation associated with it is useless. Carryover Drafting1 reuses those representations as temporary context for the next drafting round, while the main model continues to verify every new proposal. ...