FLoKD: Adaptive Knowledge Distillation for Federated Low-Rank LLMs
September 15, 2026
FLoKD reduces communication overhead in federated fine-tuning over wireless networks by using adaptive knowledge distillation. It addresses the trade-off between logit reduction and supervision quality, optimizing the transmission of LoRA-based parameters and outputs.
HOW THIS AFFECTS YOU
●
builderYou can deploy LLM fine-tuning to edge devices with constrained bandwidth.
●
researcherThis provides a method to balance communication costs against model accuracy in federated settings.