PLUME Framework Enables Efficient LLM Personalization via Low-Rank Modulation

PLUME reduces the storage overhead of per-user fine-tuning by using a shared task-specific subspace and lightweight square matrices. It allows for expressive individual adaptation by training only a small set of parameters within a global subspace, significantly cutting redundancy.