compositionality

Definition

The property that the meaning of a whole is determined by the meanings of its parts and the way they are combined. It matters empirically because it predicts generalization to unseen combinations of seen elements — the target of compositional generalization benchmarks. The contrast is with memorization: a model lacking compositionality handles every combination it was trained on and fails abruptly on a novel arrangement of entirely familiar pieces.