Probabilistic JEPA interpreted as Hidden Markov Model

A new analysis shows that time-indexed Predictive Information Bottleneck VJEPA functions as a Hidden Markov Model. The researchers introduce Markov-Chain JEPA (MCJEPA), which uses a learned transition matrix to ensure multi-horizon Chapman–Kolmogorov consistency.