Weak Supervision

TL;DR for operators A visual search system may detect every object in an image yet still return the wrong one when a user describes a particular target. LaMER1 addresses that selection problem by combining four pretrained visual encoders through language-conditioned routing, without using annotated target bounding boxes during its own training. The reported system achieves 77.67% on RefCOCO, 62.81% on RefCOCO+, and 69.49% on RefCOCOg validation, measured as the percentage of predicted boxes reaching at least 0.5 intersection-over-union with the annotated target. More revealingly, adding cross-attention routing to an existing four-expert configuration improves accuracy by 2.5 and 4.6 percentage points on RefCOCO and RefCOCO+, respectively. ...

TL;DR for operators SinBrief1 addresses a familiar specialised-AI problem: a team has documents worth summarising but no large collection of human-written document-summary pairs. Instead of making an end-to-end language model solve the entire task, it divides the work between structured candidate generation and a learned scorer. That decomposition produced the paper’s strongest reported result. On 242 held-out Sinhala legal documents, SinBrief using a base Llama 3.1 scorer reached a SummaC score of 0.752. A version whose Llama 3.1 backbone had been continually pre-trained on the legal corpus reached 0.591. The base model also had higher sentence-scorer validation accuracy: 90.05% versus 88.37%. ...

TL;DR for operators After building a teacher model, a development team faces a familiar allocation question: generate more teacher-labeled examples, increase student capacity, or do both. The usual scaling intuition is incomplete. Zeinalpour and Najafi show that a student can outperform its teacher even when both use the same linear hypothesis class and training rule, converge exactly, and use neither ridge regularization nor early stopping.1 The improvement comes from a finite Stage-II resource: the student cannot reproduce every component of the teacher, and the resulting restriction can remove more teacher error than useful signal. ...

TL;DR for operators An audit team has more financial statements than it can investigate deeply, so the first operational question is which files deserve attention and what an auditor should inspect once one is flagged. This system is much stronger at the first task than the second. Its strongest reported regression configuration, SVR M17, has an average of 0.83 among the twenty highest-ranked statements when measured against the paper’s proxy-positive criterion. The best explanation method, EiForest, reaches only 0.24 average F1 in the seven-company explanation evaluation. ...

TL;DR for operators Training budget is usually where elegant AI strategy goes to die. The paper behind this article argues that preference tuning does not always need a superior teacher response. It may only need a useful contrast. A model can improve by learning that one weak answer is better than an even weaker one, even when neither answer is as good as what the model can already produce.1 ...