Disentangling InceptionV1 neurons via Hadamard product clustering
July 15, 2026
A new mechanistic interpretability method identifies monosemantic patterns by clustering the Hadamard product of a neuron's receptive field and its weights. Applying this to 1x1 convolutional neurons in InceptionV1 successfully isolated distinct activation clusters for cars, cats, dogs, and text characters.
HOW THIS AFFECTS YOU
●
researcherYou can use this clustering technique to better understand feature detection in convolutional architectures.