priors

Definition

Assumptions placed on a model before seeing data; in Bayesian terms, distributions over unknowns. In generative modelling and compression the prior is the probability model of the latent variables, and its quality translates directly into bitrate: the closer it matches the true distribution, the fewer bits each code costs. Modern work usually learns the prior rather than fixing it by hand.