ZeroLock: Concurrent Memory-Efficient LLM Training via Modular Update Decoupling
Researchers introduced ZeroLock, a backpropagation-free algorithm that decouples large language model updates into independent chunk updates, reducing memory usage by 26.5% and improving throughput by 4.9% compared to ba…