progress

Definition

Real forward movement in capability, as distinct from a higher number on a leaderboard. Much methodological criticism turns on whether the two coincide: saturated benchmarks, leaked test data, and metrics gameable by shortcuts all let scores climb without progress. When a paper questions progress, it is asking whether the field's measuring instruments still track the thing they were built to track.