bohb

Definition

BOHB combines Bayesian optimisation with Hyperband. It keeps Hyperband's cheap early stopping, which pulls budget away from weak configurations, but replaces the random sampling of new configurations with a probabilistic model fitted to the results observed so far. The goal is Hyperband's strong any-time behaviour early on plus model-guided convergence once enough evaluations have accumulated.