self-improvement

Definition

A loop in which a model generates candidate solutions, filters them, and trains on whatever survives — reducing the need for human annotation. It works best where correctness can be checked mechanically, since the filter, not the generator, is what supplies new information. The ceiling is set by the quality of that verifier; without a good one, the loop mostly amplifies existing bias.

Explainers using this term

• Paper Walkthrough: PILOT in the Loop — Fixing the Run While It Is Still RunningPILOT in the Loop: Live Self-Improvement for Long-Horizon Agents
• Paper Explained: Does On-Policy Distillation Really Distill? From Noisy Teacher to Self-ImprovementDoes On-Policy Distillation Really Distill? From Noisy Teacher to Self-Improvement
• Paper Deep-Dive: Frontis-MA1 — Training the AI That Builds AI: One Step Toward Recursive Self-Improvement in ML EngineeringFrontis-MA1: Training an AI4AI Model towards Recursive Self-Improvement in Machine Learning Engineering