{"slug": "a-survey-on-memory-efficient-fine-tuning-for-large-language-models", "title": "A Survey on Memory-Efficient Fine-Tuning for Large Language Models", "summary": "Yeachan Kim, Mingyu Lee, and SangKeun Lee published \"A Survey on Memory-Efficient Fine-Tuning for Large Language Models\" in Transactions of the Association for Computational Linguistics, Volume 14, pages 960–982, in 2026. The survey presents what the authors describe as the first systematic review of memory-efficient fine-tuning (MEFT) for LLMs, categorizing existing approaches by optimization environment (the model itself and systems) and further classifying model-based approaches by optimization target. The paper also discusses evaluation strategies for MEFT methods and provides empirical analyses, aiming to serve as a practical guide for developing MEFT methods.", "body_md": "##### Abstract\n\nFine-tuning large language models (LLMs) is a crucial process to align them with human intentions, yet this process remains memoryintensive, varying across tasks and model architectures. These huge and variable memory costs complicate scaling and deployment of LLMs, especially on limited hardware. However, existing surveys on memory efficiency are often either superficial or too narrow in scope, typically focusing on specific subfields. To address this gap, this survey presents the first systematic review of memory-efficient fine-tuning (MEFT) tailored for LLMs. To structure the research landscape, we first categorize existing approaches by their optimization environments (i.e., model itself and systems) and further classify model-based approaches by their specific optimization targets. We also discuss evaluation strategies for assessing MEFT methods and provide empirical analyses. By highlighting challenges and future directions based on current methods, this survey aims to serve as a practical guide for developing MEFT methods.\n- Anthology ID:\n- 2026.tacl-1.43\n- Volume:\n- [Transactions of the Association for Computational Linguistics, Volume 14](https://aclanthology.org/volumes/2026.tacl-1/)\n- Month:\n- Year:\n- 2026\n- Address:\n- Cambridge, MA\n- Venue:\n- [TACL](https://aclanthology.org/venues/tacl/)\n- SIG:\n- Publisher:\n- MIT Press\n- Note:\n- Pages:\n- 960–982\n- Language:\n- URL:\n- [https://aclanthology.org/2026.tacl-1.43/](https://aclanthology.org/2026.tacl-1.43/)\n- DOI:\n- [10.1162/tacl.a.692](https://doi.org/10.1162/tacl.a.692)\n- Cite (ACL):\n- Yeachan Kim, Mingyu Lee, and SangKeun Lee. 2026. [A Survey on Memory-Efficient Fine-Tuning for Large Language Models](https://aclanthology.org/2026.tacl-1.43/) .*Transactions of the Association for Computational Linguistics* , 14:960–982.\n- Cite (Informal):\n- [A Survey on Memory-Efficient Fine-Tuning for Large Language Models](https://aclanthology.org/2026.tacl-1.43/) (Kim et al., TACL 2026)\n- PDF:\n- [https://aclanthology.org/2026.tacl-1.43.pdf](https://aclanthology.org/2026.tacl-1.43.pdf)", "url": "https://wpnews.pro/news/a-survey-on-memory-efficient-fine-tuning-for-large-language-models", "canonical_source": "https://aclanthology.org/2026.tacl-1.43/", "published_at": "2026-10-07 00:00:00+00:00", "updated_at": "2026-10-08 00:17:40.599963+00:00", "lang": "en", "topics": ["large-language-models", "machine-learning", "ai-research", "artificial-intelligence"], "entities": ["Yeachan Kim", "Mingyu Lee", "SangKeun Lee", "Transactions of the Association for Computational Linguistics", "MIT Press", "TACL"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/a-survey-on-memory-efficient-fine-tuning-for-large-language-models", "markdown": "https://wpnews.pro/news/a-survey-on-memory-efficient-fine-tuning-for-large-language-models.md", "text": "https://wpnews.pro/news/a-survey-on-memory-efficient-fine-tuning-for-large-language-models.txt", "jsonld": "https://wpnews.pro/news/a-survey-on-memory-efficient-fine-tuning-for-large-language-models.jsonld"}}