Analyzing AdamW Optimizer State Effects on Minibatch Perturbation Dynamics
August 21, 2026
AdamW is modeled as a finite-horizon input-state-output system to track how optimizer memory influences future loss effects. The study uses a signed response operator to map localized gradient perturbations to their delayed magnitude and timing in subsequent training updates.
HOW THIS AFFECTS YOU
●
researcherThis provides a formal framework for understanding how optimizer states propagate gradient noise across training steps.