unification

Definition

Folding tasks, modalities, or methods that were handled separately into a single framework or model — understanding and generation in one network, several modalities behind one tokenizer, several objectives under one loss. The appeal is shared representation and simpler deployment; the recurring question is whether the unified model matches specialists on each individual task, which papers claiming unification are expected to test.

Explainers using this term

• Paper Deep-Dive: The 'Physics' of Multimodal Pretraining — Which Way Does Knowledge Actually Flow?Towards Physics of Multimodal Pretraining: Knowledge Flow, Modality Synergy, Early Unification, and Recipes