FLoKD: Adaptive Knowledge Distillation for Federated Low-Rank LLM over Wireless Networks
Researchers proposed FLoKD, an adaptive knowledge-distillation framework for federated LoRA fine-tuning of large language models over wireless networks that transmits intermediate LoRA activations instead of logits or fu…