JoyInside-VLM-Agent Uses Product-Conditioned Trajectories for Embodied Policy Learning
October 12, 2026
JoyInside-VLM-Agent employs ReAct-style multimodal reasoning for robotic agents using product-conditioned trajectory construction. The framework utilizes Dual-Source Privileged On-Policy Self-Distillation (DPER) to route token-level evidence between a frozen privileged teacher and a student, enabling closed-loop failure recovery and goal adaptation.
HOW THIS AFFECTS YOU
●
builderThis provides a method for training agents to handle goal revisions and execution failures in smart hardware.
●
researcherYou can leverage the DPER mechanism to improve reward modulation in multi-teacher distillation setups.