Applying length penalties in reinforcement learning can compress reasoning tokens without eliminating the underlying influence of misleading hints in models like Qwen3-4B and 14B.
HOW THIS AFFECTS YOU
●
researcherBe aware that token-accuracy metrics may hide steering effects even when reasoning traces appear clean.
●
policyCompressed reasoning traces may make it harder to audit how models arrive at specific conclusions.