transformer-based

Definition

Built on the Transformer architecture — stacked blocks of attention and feed-forward layers — with whatever modifications the paper contributes layered on top: different positional encodings, normalization placement, attention variants, mixture-of-experts feed-forwards. The phrase mainly signals what the baseline structure is, and the implicit contrast is with recurrent, convolutional, or state-space architectures that process sequences without global attention.