LOCUS uses task-aware low-rank adaptation to select subspaces that minimize output sequence length without sacrificing utility. On Pythia-2.8B, it reduced continuation length by 39.84%, and on Qwen2.5-3B, it achieved reductions of up to 17.58% by updating less than 0.3% of parameters.
HOW THIS AFFECTS YOU
●
builderYou can significantly lower inference costs by reducing verbosity via low-rank post-training.
●
founderThis provides a method to optimize the margin on LLM-based products by cutting token-heavy outputs.