Same Modalities, Different Loss: Pairing Is Its Own Multimodal Data Budget
TL;DR for operators A multimodal dataset can contain the same amount of image, text, audio, or other modality-specific data yet produce different model performance depending on how often those modalities occur together. Marcus Ma and Shrikanth Narayanan isolate that distinction in Paired Multimodal Scaling Laws1, varying pairing while holding modality-specific data budgets fixed across three supervised environments. ...