projections

Definition

Linear maps that send vectors into another space, typically implemented as a weight matrix multiply. Inside a Transformer, the query, key, and value projections are exactly this, and each attention head learns its own set. The same word covers two distinct uses: reducing dimensionality to compress, and aligning representations from different modalities — a vision encoder's output projected into the language model's space — into one shared geometry.