GraphMuon is a graph-aware optimizer that adapts Muon's matrix-aware updates to the covariance structure of graph-propagated layer inputs. This addresses how weight updates are amplified when applied to graph-propagated features in GNNs.
HOW THIS AFFECTS YOU
●
researcherYou can use this optimizer to account for how graph-propagated representations shape the effective geometry of weight matrices.