Policy-internal rewards improve reasoning reliance in small instruction-tuned models

Four lightweight rewards—gradient sensitivity, confidence gaps, progressive confidence gains, and reasoning-prompt swaps—are integrated into GRPO to encourage models to rely on their generated reasoning. Experiments on GSM8K and StrategyQA show increased answer reliance to reasoning edits, though a trade-off between reliance and task accuracy exists.