More Math, Less Finance: The Checkpoint Trade-off
TL;DR for operators A financial AI model can become substantially better at mathematical reasoning while losing financial knowledge acquired during earlier training. In one Japanese financial-model pipeline, reasoning training raised mathematical accuracy by 9.5 percentage points but reduced financial knowledge accuracy by 21.9 points. Subsequent financial training recovered much of the loss without fully restoring the earlier score. ...