Net Utility Metric Enables Budget-Aware LoRA Merging
September 2, 2026
Net Utility is a data-free metric that decomposes LoRAs via SVD to score singular directions based on task utility and interference. This allows for non-uniform rank allocation during merging, closing the performance gap between merged and per-task adapters.
HOW THIS AFFECTS YOU
●
builderYou can deploy multi-task models more efficiently by merging LoRAs using variable rank budgets instead of uniform ones.
●
researcherThe approach bypasses the NP-hard problem of rank selection by using SVD-based utility scoring.