JEPA Architectures Prove the Platonic Representation Hypothesis

This research proves a Platonic Representation Theorem showing that Joint-Embedding Predictive Architectures (JEPAs) trained on different modalities converge to the same representation up to a rotation. The authors demonstrate that next-token prediction is a JEPA with sub-optimal views, explaining why language alignment with vision requires scale.