On the Invariants of Softmax Attention

概要

arXiv:2605.02907v1 Announce Type: cross Abstract: Softmax attention maps every query--key interaction into a probability distribution, but the underlying structure remains largely unexplored. We define the \emph{energy field}, the row-centered attention logit, and show that it exhibits invariant pr…