HIL-UMI for Robot-Free Human-in-the-Loop VLA Post-Training

HIL-UMI enables post-training of vision-language-action models during handheld demonstrations without requiring physical robot execution. It uses an Energy Score to compare human trajectories against current policy predictions on the same observation stream to identify useful intervention points.