Model-Generalization

TL;DR for operators A platform team supporting several language models can achieve respectable task coverage while still delivering inconsistent results across those models. The relevant question is not only whether some supported model completes a task, but whether the same agent harness works reliably with every supported model. MaD-RSI, proposed by Yu Cui and colleagues,1 addresses this problem by using execution successes and failures from heterogeneous, frozen LLMs to improve one shared harness. On MedXpertQA, it matches the strongest single-model optimization baseline’s 60% four-model success coverage while raising joint success from 13% to 18%. ...

TL;DR for operators A knowledge graph may observe the same relational pattern only a handful of times and still use an embedding model whose architecture effectively treats that pattern as valid everywhere. That is not merely a sparse-data problem. It is a generalization-control problem. Kim and Kim call this failure pattern over-generalization and propose PogRE, a knowledge graph embedding architecture designed to make a pattern’s reach expand as supporting evidence covers more independent directions in embedding space.1 The paper reports both competitive link-prediction results and lower targeted over-generalization measurements than TransE, RotatE, PairRE, and CompoundE in the evaluated settings. ...