SpecMRL Improves Matryoshka Representation Learning via Spectral Basis

SpecMRL redesigns Matryoshka Representation Learning by organizing a parameter-derived spectral basis by feature importance. This reorganization enables more effective prefix readout, outperforming standard MRL on MTEB benchmarks, particularly under aggressive compression.