Query (Q)
The "what am I looking for?" projection of each position.
The "what am I looking for?" projection of each position. Q = X · W^Q. Compared against all keys to compute attention scores.
The "what am I looking for?" projection of each position.
The "what am I looking for?" projection of each position. Q = X · W^Q. Compared against all keys to compute attention scores.