Legible-by-Construction Transformers Convert Attention Heads into Readable Detectors

This method reconstructs transformer attention heads using sigmoid-activated value channels to act as explicit feature detectors. A Boolean variant utilizes within-token intersection and negation-capable set-difference to make the attention mechanism interpretable without losing model quality.