Structural Limits and Spectral Collapse in Geospatial Location Encoders

Research shows Lipschitz location encoders are limited to an intrinsic dimension of at most 2, causing contrastive loss to exceed its optimum. Current methods avoid spectral collapse by training against frozen image encoders acting as high-rank covariance regularizers.