Learning reveals invisible structure in low-rank RNNs

Learning reveals invisible structure in low-rank RNNs Researchers derived closed-form ODE systems governing gradient-descent learning dynamics in low-rank RNNs, exact for linear networks and asymptotically exact for nonlinear networks in the large-N Gaussian limit. The key insight splits synaptic overlaps into loss-visible and loss-invisible components, where the latter are functionally silent yet mechanistically essential for describing weight updates. Computational neuroscientists and RNN theorists building interpretable models of cognition or motor control should take note, as this framework bridges connectivity structure and learning trajectories analytically. Prior low-rank RNN theory addressed activity but not learning; this closes that gap with tractable, reduced-dimensional dynamics.