bootstrapping

Definition

Improving a model by training it on its own filtered outputs: sample many attempts, keep the ones that pass a check, fine-tune on those, repeat. It works best where correctness is cheap to verify — maths with a known answer, code with unit tests — because the filter, rather than a human annotator, supplies the supervision. Unrelated to the statistical bootstrap, which is a resampling technique for estimating variance.