Weight Direction Drives Circuit Identity During Grokking
July 9, 2026
Chimera interventions reveal that weight direction, rather than magnitude, carries transferable circuit identity in modular arithmetic grokking tasks. Recombining a donor's direction with a recipient's norm successfully drives the model to the donor's specific circuit in 100% of tested cases.
HOW THIS AFFECTS YOU
●
researcherYou can use direction-norm dissociation to probe how specific functional circuits are encoded in weights.