Critic Invocation Policy Improves Agent Evaluation in Terminal Environments

Evaluation of Monte Carlo tree search in computer-use environments shows that critics often fail due to partial observability and uninformative intermediate states. The study suggests a more efficient policy: invoking the critic only at nodes the agent identifies as final rather than during partial progress.