Hierarchical Framework for On-Policy and Off-Policy Agent Distillation

This framework separates the policy inducing interaction history from the policy generating token prefixes during distillation. Experiments show that pairing student-induced histories with teacher-generated action prefixes improves performance across interactive environments compared to traditional methods.