TaxoSAE Implements Taxonomic Logic into Sparse Autoencoder Feature Spaces
October 26, 2026
TaxoSAE uses a stack of SAEs and a taxonomic alignment loss to encode hypernym-hyponym relations directly into LLM feature representations. This method improves readout accuracy by ensuring features are active in a way that respects hierarchical knowledge structures.
HOW THIS AFFECTS YOU
●
researcherYou can use this approach to achieve more granular and logically consistent control over LLM internal representations.