The Role of Symmetry in Optimizing Overparameterized Networks

概要

arXiv:2604.25150v3 Announce Type: replace-cross Abstract: Overparameterization is central to the success of deep learning, yet the mechanisms by which it improves optimization remain incompletely understood. We analyze weight-space symmetries in neural networks and show that overparameterization in…