Shared Residual Distillation for Learning from Unverified Peer Trajectories

Shared Residual Distillation (SRD) enables language models to improve using unverified self-generated trajectories. The method compares how peer solutions alter prediction distributions relative to a control, allowing the model to extract value from intermediate reasoning even when final answers cannot be verified.