FedLore Enables Efficient Federated Learning via Shared Low-Rank Projections
October 2, 2026
FedLore addresses subspace fragmentation in federated learning by sharing a low-rank optimization basis within each training round. This approach allows for exact aggregation in low-rank coordinates and enables accumulated model updates to exceed the per-round rank budget.
HOW THIS AFFECTS YOU
●
builderYou can reduce communication costs and memory overhead during federated training of foundation models.
●
researcherThis method provides a way to bypass the limitations of fixed rank budgets in LoRA-based federated learning.