The Masked Boundary Pause (MBP) method places special tokens at reasoning-step boundaries with masked loss to improve training dynamics. Testing across 1B-8B Qwen and Llama models shows MBP consistently improves reasoning performance by up to 6 points.
HOW THIS AFFECTS YOU
●
builderYou can implement MBP to boost reasoning capabilities in smaller open-weight models.
●
researcherThis offers a new perspective on how pause tokens reshape model training dynamics.