Graph-Transformers

TL;DR for operators A graph-transformer job that is too large or too slow for one GPU presents two separate questions: how to divide the work, and how many GPUs are worth allocating. Treating the second question as “more is faster” is unreliable. In Scalable and Adaptive Parallel Training of Graph Transformer on Large Graphs, Lin, Madduri, and Kandemir1 report 8-GPU A100 speedups of 6.1x for ogbn-proteins, 3.3x for ogbn-products, and 4.2x for Reddit. The same accelerator count therefore produces materially different returns across graph workloads. The preferred parallelization strategy also changes across graph and hardware configurations. ...

Benchmarks Are Where Models Stop Being Inspirational Benchmarks are not glamorous. They are where models go after the demo video, after the conference slide, and after the sentence “this generalizes beautifully” has done its little dance in front of investors. Graph learning badly needs that room. For years, graph machine learning has been evaluated on comfortable territory: molecular graphs, citation networks, small academic datasets, and carefully packaged tasks that are useful but narrow. That helped the field grow. It also created a quiet distortion. A model could look impressive while never having to deal with a social network that changes over time, a circuit whose tiny structural error destroys correctness, a SAT instance where solver choice matters, or a weather graph where the planet is inconveniently spherical. ...

Fog of Neuro: Why Speech May Become the Next MRI Speech is a strange medical instrument. It does not look like one. It does not come with a scanner room, a radiology report, or a patient lying very still while a machine complains loudly. It comes out in ordinary life: a story, a pause, a word search, a sentence that loses its thread halfway through. For many neurological conditions, especially rare metabolic and neurodegenerative diseases, that ordinary speech may contain something today’s clinic often misses: the patient’s real cognitive state between appointments. ...