position

Definition

Where a token sits in a sequence. Self-attention is permutation-invariant on its own — it sees a set, not an order — so position must be injected explicitly, and how it is injected (absolute embeddings, relative biases, rotary) is a real architectural fork with consequences for length generalization. In graphics papers the same word means a 3D coordinate, so let the context decide.