SpaRLax uses sparse relaxation for differentiable soft-CoT reasoning

SpaRLax is a sparse reinforcement learning relaxation method designed to train LLMs using differentiable soft Chain-of-Thought (CoT) tokens. Unlike standard RL, it propagates gradients through soft tokens to capture the dependencies between reasoning steps.