Localization

TL;DR for operators When a translation is already mostly correct, another broad LLM rewrite can create new problems faster than it removes the remaining one. In Wang and Wu’s domain-specific machine-translation study,1 an initial EN→DE post-edit reached 89.93 COMET-22. Six of seven tested second-round editors failed to improve that result; five lowered it, one left it unchanged, and only reusing Claude Sonnet 4.5 produced a small increase to 90.07. ...

TL;DR for operators An archive of expensive human corrections does not automatically remain a valid training target after the production model improves. In the paper introducing StalePO,1 legacy post-edits are often closer to the older NMT system than to the upgraded model, yet they can still contain corrections worth recovering. StalePO handles that mismatch by learning the relative signal in the old preference pair while explicitly protecting the new model’s existing response and constraining changes at token level. ...

TL;DR for operators UrduBench1 tests 23 open and open-weight models on 2,390 held-out Urdu questions spanning arithmetic reasoning, formal mathematics, commonsense, and knowledge tasks. The ranking gives little support to selecting an Urdu model from parameter count or a “reasoning” label alone: Gemma-3-12B-it leads the reported aggregate at 59.4%, while the larger reasoning-oriented DeepSeek-R1-Distill-Qwen-14B scores 44.9%. ...

Recipe localization looks like an easy prompt. “Create a Jamaican version of Moroccan couscous.” The model smiles politely, throws in jerk seasoning, allspice, scotch bonnet, maybe coconut milk if it is feeling ambitious, and returns something that looks country-specific enough to survive a quick marketing review. The title says “Jamaican.” The ingredients sound Jamaican. The format is clean. No hallucinated oven temperature from another dimension. Excellent, ship it. ...

TL;DR for operators The paper does not merely say that GPT-generated stories contain national clichés. That would be mildly interesting, in the way that discovering a tourist brochure likes sunsets is mildly interesting. The sharper finding is structural. When Rettberg and Wigers prompted gpt-4o-mini to write 1,500-word “potential” stories for 236 demonyms, the model produced surface diversity—olive trees, fjords, forests, trains, village elders, festivals—but repeatedly returned to the same basic narrative machine: someone comes back to a small town or village, discovers that community or tradition has weakened, organises a symbolic event, and restores harmony.1 ...