Counterfactual Sensitivity for Long-CoT Reasoning Credit Reallocation

This work addresses the limitation of uniform reward broadcasting in methods like GRPO by using counterfactual sensitivity to reallocate credit. By re-scoring trajectories under opposing outcome conditions, the method identifies which specific tokens actually drive the correctness of long-chain-of-thought reasoning.