GLUScope for Analyzing GLU Neuron Activation Quadrants
October 22, 2026
GLUScope is an open-source interpretability tool for analyzing GLU-based activation functions used in modern Transformers. It maps four distinct activation quadrants (gate and in-activation sign combinations) to reveal how neurons promote or suppress specific tokens.
HOW THIS AFFECTS YOU
●
researcherYou can gain deeper mechanistic insights into modern LLMs by analyzing both gate and in-activation signs simultaneously.