Compression Reduces Model Test-Time Adaptation Performance
September 4, 2026
Structured compression in ResNet-18 and ViT-Base models significantly degrades test-time adaptation (TTA) capabilities under distribution shifts. The degradation stems from reduced representational diversity and structural constraints that limit the model's ability to recover accuracy via supervised adaptation.
HOW THIS AFFECTS YOU
●
builderDeploying highly compressed models may limit their ability to adapt to real-world distribution shifts in production.
●
researcherYou should account for reduced expressivity when combining compression with TTA methods.