HiPACE Predicts Feature Absorption in Sparse Autoencoders

HiPACE introduces a closed-form prediction for feature absorption in Sparse Autoencoders (SAEs), identifying when parent concepts collapse into shared directions. The method uses a hierarchical Bernoulli generator to define a phase boundary based on active children and residual scale.