distributed

Definition

Two distinct senses. In representation learning, a distributed representation spreads meaning across many dimensions instead of assigning one symbol per concept — the property that lets neural networks generalize between related inputs, and the core contrast with symbolic approaches. In systems work, distributed training means splitting model weights, data, or both across many GPUs and nodes. The surrounding words disambiguate.