error

Definition

The gap between a prediction and the target; training is formalised as reducing it, and the difference between training error and held-out error is what generalisation debates are about. Watch for a second, purely mathematical sense hiding inside compounds: the error in Gaussian Error Linear Unit refers to the Gaussian error function, not to a mistake the model made.