Analysis of Sparsified MLPs and Transcoders in Transformer Models

Research indicates that many transcoder features are actually neurons in disguise, accounting for a substantial fraction of active features in late layers. While transcoders aim to provide interpretable approximations of MLP layers, neuron features show a more stable correspondence with the underlying MLP architecture.