dimension

Definition

The number of coordinates used to describe a point. Embedding dimension is a core design knob: too small and distinct inputs collapse together, too large and you pay compute for redundant directions. Keep two senses apart — ambient dimension is how many numbers you store, intrinsic dimension is how many degrees of freedom the data actually has. Learning is tractable largely because the second is much smaller than the first.

Explainers using this term

• Unsupervised Learning from Scratch — Clustering and Dimensionality ReductionUMAP: Uniform Manifold Approximation and Projection for Dimension Reduction