hyperband

Definition

A bandit-style approach to hyper-parameter search: run many configurations on a small budget, discard the weakest, and give the survivors more. Hyperband wraps successive halving in an outer loop over several stopping aggressiveness levels, hedging against killing a slow-starting configuration too early. It still samples configurations at random — adding a model to choose them is what BOHB does.