REACT framework for humanoid-human interaction via VLM guidance
October 21, 2026
The REACT framework uses VLM-guided contact modeling to transfer semantic contact structures from human-human demonstrations to humanoid robots. This mitigates pose estimation failures caused by heavy mutual occlusion during physical contact.
HOW THIS AFFECTS YOU
●
researcherYou can use semantic contact as a supervisory signal to learn deployable interaction policies under partial observability.