Rethink MAE with Linear Time-Invariant Dynamics

Researchers propose SSMProbe, a State Space Model-based probing framework that exploits token ordering in frozen visual representations (MAE, BEiT, DINOv2, ViT) by treating sequence position as information-critical through Linear Time-Invariant dynamics, outperforming permutation-invariant probes like Global Average Pooling on classification benchmarks.