encoders

Definition

The part of a model that maps an input into an internal representation — a vector, or a sequence of them — for something else to consume. Encoders suit tasks that read rather than write: classification, retrieval, clustering, similarity. Although decoder-only architectures dominate current large language models, encoders remain the standard choice wherever what you need is a good embedding rather than generated text.