Adversarial Training Decouples Representational Simplicity from Causal Circuit Size

Using GPT-2 Small, this study demonstrates that adversarial training can reshape internal representations to be simpler without reducing the actual size of the causal circuits required to perform tasks. This suggests that interpretability metrics like feature attribution do not always predict circuit tractability.