Query / Key / Value (Q / K / V)

Appears in 1 tutorial

Per-token vectors: Query ("what I seek"), Key ("what I offer"), Value ("info I provide").

Per-token vectors: Query ("what I seek"), Key ("what I offer"), Value ("info I provide"). Attention matches Queries against Keys to blend Values.