Fork Where the Model Changes Its Mind: Belief-Shift Branching for Tree-Structured Reinforcement Learning

Belief-shift branching optimizes critic-free reinforcement learning by placing rollouts at points where a model's answer belief diverges. Instead of using fixed intervals or entropy, this method identifies pivots in the value curve to maximize the credit signal from sibling outcome differences within limited sampling budgets.