Topological Signatures of Grokking
概要
arXiv:2605.06352v1 Announce Type: cross Abstract: We study the grokking phenomenon through the lens of topology. Using persistent homology on point clouds derived from the embedding matrices of a range of models trained on modular arithmetic with varying primes, we identify a clear and consistent t…