Restoring Action-Sensitivity in JEPA World Models via Inverse-Dynamics
October 5, 2026
Applying an inverse-dynamics auxiliary loss to encoder latents restores action-sensitivity in LeWM world models, increasing task success from 0.3% to 35% on the SLIM pushing benchmark. The method fixes encoders that fail to encode object or pusher positions during latent rollouts.
HOW THIS AFFECTS YOU
●
researcherYou can use inverse-dynamics losses to prevent latent representations from becoming action-insensitive in world models.