Evolution Strategies Rise to Fine-Tuning Giant LLMs
Researchers have successfully applied evolution strategies (ES) to fine-tune large language models at a billion-parameter scale without dimensionality reduction, marking a first that challenges reinforcement learning's d…