Freeze the Decoder, Heal the Encoder: Parameter-Efficient Adaptation for SVD-Based KV-Cache Compression

Applying a shared learning rate across different parameter counts in PEFT benchmarks creates false significance by depressing large-parameter updates while inflating small-parameter variance. In SVD-based KV-cache compression, this confound makes encoder-only fine-tuning appear superior to full factor tuning. Adjusting learning rates per parameter volume is required to measure true performance recovery.