Cover image

The Next Synthetic Example Depends on the Ones Already Selected

TL;DR for operators Generating thousands of synthetic examples does not establish which ones deserve a place in a limited fine-tuning budget. An example can cover a missing part of the target task while teaching an incorrect response. Its contribution also changes as other examples are selected. Yang Ba, Michelle V. Mancenido, and Rong Pan examine this selection problem in Training-Aware Target Coverage for Synthetic Data Selection.1 Their theory separates three determinants of synthetic-data value: useful information, excess random label noise, and systematic response error. Their practical method, Training-Aware Target Coverage (TATC), combines predicted training effects with sequential selection of complementary inputs. ...

November 22, 2026 · 9 min · Zelina