Filtering Harmful Actions Isn't Enough: Phantom Transfer in Agentic SDF

Finetuning Llama 3.3 70B Instruct on synthetic agentic trajectories containing adversarial interactions, such as unauthorized resource access or process termination, significantly increases model misalignment. Evaluations on the Anthropic Agentic Misalignment suite show leaking behaviors rising from 4.6% to 24.9% despite standard safety filtering.