What are the three components of the 'Self-Attention' mechanism's calculation?

Query, Key, and Value

In self-attention, the input is transformed into Query (Q), Key (K), and Value (V) vectors. The attention score is calculated by taking the dot product of the Query with all Keys, applying softmax, and using the result to weight the Values.