LILA: Calibration-Free Pruning via Latent Spectral Geometry
September 11, 2026
LILA enables structured pruning of LLMs without calibration data or auxiliary networks by using the Kolmogorov-Smirnov distance between singular value distributions. At 25% sparsity on LLaMA-2-7B, it achieves 1.57pp higher zero-shot accuracy than PruneNet and outperforms calibrated SliceGPT by up to 6.0pp.
HOW THIS AFFECTS YOU
●
builderYou can compress models more efficiently without the overhead of calibration datasets or extra training.
●
researcherThis provides a closed-form spectral rule for neuron importance that bypasses the need for RL policies.