regularization

Definition

Anything that deliberately constrains fitting so a model generalises instead of memorising — weight decay, dropout, augmentation, early stopping, label smoothing. The common mechanism is giving the model less freedom, or a noisier signal, than the raw objective would allow. Judge it by the right number: regularisation usually makes training loss worse, and that is fine as long as held-out performance improves.