bandit-based

Definition

Built on the multi-armed bandit formulation: given a limited budget of trials, decide how to split it between exploring options whose value is still uncertain and exploiting the ones that already look good. Hyper-parameter search, recommendation and ad allocation all use it. A bandit is simpler than full reinforcement learning because there is no state that your actions carry forward.