Convergence Guarantees for Muon Optimizer and Muesterov Variant
September 28, 2026
Muon is proven to satisfy asymptotic convergence and linear function value convergence under a global Polyak-Lojasiewicz condition. The analysis treats the Newton-Schulz implementation as a bounded preconditioner, enabling a new Nesterov-based variant called Muesterov with identical guarantees.
HOW THIS AFFECTS YOU
●
researcherYou can apply Lyapunov analysis to preconditioned heavy-ball methods using these new convergence proofs.