embedding

Definition

A dense vector representation of a discrete object — a token, a sentence, an image — arranged so that semantic similarity shows up as geometric proximity. Embeddings are the substrate for retrieval, clustering, classification, and the retrieval half of RAG, and they are also the input layer of every Transformer. The word names both the mapping and the vector it produces, which is usually clear from context.

Explainers using this term

• Paper Walkthrough: WeMM-Embedding — Putting Text, Images and Video on One RulerWeMM-Embedding: WeChat Multi-Modal Embedding Technical Report