earlyeval

Definition

A coined name from "early" plus "evaluation": judging a run from partial evidence — a few hundred training steps, a truncated generation — instead of waiting for it to finish. The motivation is cost, since most candidates in a search can be discarded long before they are fully trained or decoded. It is a paper-specific label rather than established terminology, so take the definition from the source.

Explainers using this term

• Paper Walkthrough: EarlyEval — Making Agent Evaluation Cheaper by Stopping EarlyEarlyEval: Cheaper Agent Evaluation via Early Outcome Prediction