Roots of Understanding: When Transformers Try to Learn the Language of Numbers
A mechanism-first analysis of how a GPT-2-style transformer partially learns arithmetic structure from rooted-tree Dyck words—and why that is a benchmark lesson, not a factoring breakthrough.