Grammar Before Language: What Multilingual LLMs Decide First
TL;DR for operators A translation can be wrong in at least three different ways: the model can arrange words incorrectly, produce the wrong language, or choose the wrong lexical content. The paper examined here finds evidence that these are not merely different visible error types. In the tested multilingual LLMs, they often correspond to separable internal stages. ...