Accelerating Adversarial Training via Low-Rank Defense and Circuit Surrogates

This method reduces the computational cost of adversarial training for LLMs by applying representation fine-tuning (ReFT) on the defense side and using lightweight surrogate models derived from relevant circuits on the attack side. This avoids the expensive forward-backward passes through the full model during each adversarial iteration.