04:00
2026-08-18
arxiv.org
artificial-intelligence
DumpsterCluster: From Dumpster Diving to Serving LLaMA-70B on $60 GPUs
A 128-GPU cluster built entirely from retired data center GPUs, called DumpsterCluster, can serve LLaMA-70B inference at competitive throughput for $22K versus $600K for an 8-GPU Nvidia B200 system, a…