transport

Definition

The idea of moving probability mass from one distribution to another; optimal transport asks for the movement plan minimising total cost. It gives generative modelling and domain adaptation a way to measure and shrink the gap between distributions. Its practical advantage over KL is that it stays finite and informative when the two distributions barely overlap — exactly the regime a generator starts training in.

Explainers using this term

• Optimal Transport — The Mathematics of Moving DistributionsSinkhorn Distances: Lightspeed Computation of Optimal Transport