sequence

Definition

Ordered data where the order carries meaning — tokens of text, audio frames, video, actions over time. It is the field's central data type, and the sequence-to-sequence framing covers translation, summarisation, speech, and open-ended generation alike. Two properties drive the architecture: length varies per example, and dependencies can span the whole sequence, which is exactly the problem attention was introduced to solve.