1 result for “positional encoding”
A method for encoding token positions in transformer models by rotating query and key vectors, capturing relative position through rotation angles rather than additive position vectors.