A Hierarchical Energy-Based Model for Multimodal Cognition

IM-LEPP extends the single-modality LEPP framework into a hierarchical, energy-based architecture integrating vision and language. The model utilizes a hub-and-spoke hierarchy where modality-specific predictive-coding pipelines converge on a shared amodal hub. This structure ensures that local predictions are conditioned by the central hub state rather than overwritten.