[arXiv]score: 0.36

Post-Training Methods Reshape Internal Refusal Circuits in LLMs

September 4, 2026

Comparing SFT, reasoning-augmented fine-tuning, and ORPO across Llama-3.1-8B, Gemma-2-9B, and Qwen3-8B shows that training methods reshape internal refusal computation. Reasoning-augmented training produces distinct, identifiable refusal circuits, but no current method simultaneously achieves non-fragile refusal, zero capability loss, and steerability.

HOW THIS AFFECTS YOU

●

builderBe aware that safety fine-tuning may introduce fragile refusal components that are difficult to steer.

●

researcherInternal refusal mechanisms are highly dependent on the specific post-training optimization used.

●

policySafety alignment is not a solved problem; current methods involve significant trade-offs between robustness and capability.

read original ↗arxiv.org

DAILY DIGEST

you don't check 9 sources — we do. one email every morning, read in 2 min. free. unsubscribe anytime. privacy

← back to feed