Expert Subspace Overlap Analysis in Sparse MoE Routing Architectures

Analysis across six MoE architectures shows that expert subspaces overlap substantially despite routing logic. Using the Expert Subspace Separation Index (ESSI), the study demonstrates that specific routing decisions explain token representations more effectively than matched-route residuals or geometric complementarity alone.