In the Transformer architecture, what mechanism is used to provide the model with information about the order of symbols in a sequence?

Positional encoding

Since Transformers use self-attention rather than recurrence or convolution, they have no inherent sense of the relative or absolute position of tokens. Positional encodings are added to the input embeddings to inject this spatial information.