ConCal Recursive Continuation-Value Estimator for Long-Horizon Agents

ConCal reduces local credit distortion in reinforcement learning by matching task visits through shared state-action-state transitions. This method propagates calibrated values backward through rollout batches to mitigate dependence on single-sampled continuations during long-horizon tasks.