evolve

Definition

To improve across generations by repeated variation and selection. The word marks evolutionary search — mutate candidates, score them, keep the best — and increasingly labels loops where an LLM proposes and critiques its own candidate solutions, as in program-synthesis systems. Its appeal is that it needs no gradients and tolerates non-differentiable objectives; its cost is the sheer number of evaluations required.

Explainers using this term

• Paper Walkthrough: HarnessDev — Can an LLM Build and Maintain the System It Runs Inside?HarnessDev: Can LLMs Create and Evolve Their Own Agent Harness?
• Paper Walkthrough: Aspire — Can Models Self-Evolve from Vague Goals?Aspire: Can Models Self-Evolve from Vague Goals?
• Paper Walkthrough: Training Agents to Evolve with Their HarnessTraining Agents to Evolve with Their Harness: TaoLive Digital Avatar Agent Technical Report