co-adaptation

Definition

When units in a network tune themselves to compensate for each other's quirks, so a feature only means anything in the presence of its particular partners. If that mutual dependence is specific to the training set, it surfaces as overfitting — the argument behind dropout, which removes units at random during training so no unit can rely on any other. Cooperation is not the problem; brittle interdependence is.