saturation

Definition

The point at which gains flatten out. A saturated benchmark is one where leading systems cluster near the maximum score, so differences between methods stop being informative — the standard trigger for building a harder successor. The same word names a different phenomenon in optimisation: a sigmoid or tanh unit driven to its extremes has near-zero gradient and stops learning.

Explainers using this term

• Paper Walkthrough: SA-MRPO — Stop Studying the Subject You've Already AcedLearn What's Left, Not What's Mastered: Saturation Aware Advantage Reweighting for Multi-Reward Policy Optimization