Machine-Translation

TL;DR for operators When a translation is already mostly correct, another broad LLM rewrite can create new problems faster than it removes the remaining one. In Wang and Wu’s domain-specific machine-translation study,1 an initial EN→DE post-edit reached 89.93 COMET-22. Six of seven tested second-round editors failed to improve that result; five lowered it, one left it unchanged, and only reusing Claude Sonnet 4.5 produced a small increase to 90.07. ...

TL;DR for operators A translation can be wrong in at least three different ways: the model can arrange words incorrectly, produce the wrong language, or choose the wrong lexical content. The paper examined here finds evidence that these are not merely different visible error types. In the tested multilingual LLMs, they often correspond to separable internal stages. ...

TL;DR for operators An archive of expensive human corrections does not automatically remain a valid training target after the production model improves. In the paper introducing StalePO,1 legacy post-edits are often closer to the older NMT system than to the upgraded model, yet they can still contain corrections worth recovering. StalePO handles that mismatch by learning the relative signal in the old preference pair while explicitly protecting the new model’s existing response and constraining changes at token level. ...

Enterprise AI teams have developed a familiar reflex. When the model behaves unreliably, they try a better prompt. When that fails, they try a larger model. When that becomes expensive, they invent a workflow diagram with many arrows and call it an operating model. Very dignified. Very scalable, in the same way that adding more sticky notes to a broken process is scalable. ...

Translation is one of those AI workloads where scale is both a blessing and a tax. A large language model can translate with impressive robustness, follow instructions, preserve formatting, and handle messy inputs better than many older systems. Then the bill arrives. The model is not only carrying translation ability; it is also carrying mathematical reasoning, factual memory, coding patterns, roleplay habits, tool-use affordances, and several other things that are not exactly required to turn German into English. ...

TL;DR for operators Long-document translation does not fail only because the model lacks enough tokens. It fails because documents are not bags of sentences. They contain references, implied pronouns, repeated terms, topic shifts, callbacks, causal links, and the occasional sentence that makes sense only because something three paragraphs earlier did the heavy lifting. ...