04:33
2026-07-08
arxiv.org
large-language-models
From Words to Watts: Benchmarking the Energy Costs of LLM Inference (2023)
Researchers from Meta AI benchmarked the energy costs of inference for LLaMA models on NVIDIA V100 and A100 GPUs across up to 32 GPUs, finding that inference energy consumption is significant and ofte…