Robust Filter Attention: Self-Attention as Precision-Weighted State Estimation
概要
arXiv:2509.04154v5 Announce Type: replace-cross Abstract: We introduce Robust Filter Attention (RFA), a formulation of self-attention as a robust state estimator. Each token is treated as a noisy observation of a latent trajectory governed by a linear stochastic differential equation (SDE), and att…