MInTRL Uses Sparse Interventions to Boost On-Policy RL

Minimal Intervention Reinforcement Learning (MInTRL) improves exploration by periodically replacing erroneous suffixes in on-policy rollouts with short corrections from a judge policy. This method expands the exploration frontier without the distribution shifts typical of off-policy training.