convergence

Definition

The point at which loss or parameters stop changing appreciably, and the process of getting there. Convergence speed depends heavily on learning rate schedule, optimizer, and batch size, so comparisons are only meaningful at matched compute — a method that converges in fewer steps but with costlier steps has won nothing. Note also that converged does not mean correct: training can settle into a solution that generalizes badly.