Gradient Transformer: Learning to Generate Updates for LLMs
A new data-free knowledge distillation framework called Gradient Transformer enables organizations with limited computational resources to improve large language models (LLMs) using private data without sharing that data…