distance

Definition

A number quantifying how far apart two things are — two embeddings, or two whole distributions. Generative evaluation leans on the second sense: compute a distance between feature distributions of real and generated data, which is cheap and stable but blind to failures that leave aggregate statistics intact. Strictly a metric must be non-negative, symmetric, and satisfy the triangle inequality; plenty of things called distances in practice satisfy none of the three.