layer

Definition

One stage of transformation in a network: take an input, apply weights, a nonlinearity, perhaps a normalisation, hand the result onward. Depth in deep learning literally counts layers, and how they are stacked and connected is what architecture means. The word also modifies other terms by naming an axis, as in layer normalisation — statistics over a layer's features rather than over the batch.