Instruction Leakage in Compact World Models for Spatial Grounding

Evaluating goal-conditioned world models reveals that high relation-readout accuracy (0.90) often stems from instruction transcription rather than perception. Removing the goal drops accuracy to 0.27, and counterfactual instructions cause predicted anchors to follow false instructions 94.5% of the time.