discrete

Definition

Taking values from a finite or countable set rather than varying smoothly. In deep learning it usually flags a quantised latent space — VQ-VAE codebooks, RVQ tokens — or symbol-level treatment as with text tokens. Discreteness discards information relative to a continuous vector and blocks straightforward gradients, but it buys compression and lets autoregressive sequence models operate on audio or images.