automatic

Definition

Done without a human in the loop. In evaluation it means scoring by program or by model rather than by annotator — scalable, but only as trustworthy as its correlation with human judgement, which papers should report. Elsewhere it describes machinery that removes manual work entirely, as in automatic differentiation, where gradients come from the computation graph instead of being derived by hand.

Explainers using this term

• Paper Walkthrough: AutoSaddler — Growing a Harness That Doesn't Break, from Agent Failure LogsAutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Traces