reducing

Definition

Making some undesirable quantity smaller — compute, memory, variance, error, or a hypothesised pathology such as internal covariate shift. In a title the object of reducing usually states the paper's causal hypothesis: things improved because this shrank. That hypothesis is separable from the empirical result, and several famous cases turned out to work for reasons other than the reduction advertised.

Explainers using this term

• A History of Normalization Layers — From BatchNorm to RMSNormBatch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift