{"slug": "reducing-wrx80-server-idle-power", "title": "Reducing WRX80 Server Idle Power", "summary": "A user reports that their ASRock WRX80D8-2T server with an AMD Threadripper PRO 3995WX and five AMD Radeon Pro W7900 GPUs idles at about 350W, costing roughly $30 CAD monthly with 96% of power from idle draw. They reduced idle power to ~100W by enabling runtime power management on the GPUs, but S3 sleep is unsupported and hibernate fails with AMDGPU errors, so they currently rely on remote power cycling via ipmitool.", "body_md": "Hi Folks,\n\nLongtime lurker first time poster.\n\nI’ve spent the last few weeks trying to optimize idle power usage on my WRX80 server:\n\n- ASRock WRX80D8-2T\n\n- AMD Threadripper PRO 3995WX\n\n- 1 TB 2933MT/s DDR4 RDIMM, 8×128 GB\n\n- 5× AMD Radeon Pro W7900, 240GB VRAM\n\nSW:\n\n- Linux Mint 22.3 (debian)\n\n- Kernel 6.17.0-23-generic\n\n(All power draw figures measured via wall monitor)\n\nAt stock settings the server idles at around ~350W, during my primary workload (LLM inference via llama.cpp) the server hits about 700-800w power draw (non tensor parallel).\n\nBased on my power costs and assuming I have 1 hour of inference per week, the monthly power costs for this machine alone is about $30 CAD. The bigger issue is 96% of the power cost is from idle draw which is not ideal. I’ve been looking into ways to reduce the idle power specifically and found that S3 sleep would be my best option:\n\n- S3 Sleep (suspend to ram)\n\n```\n- This in theory is the best option, the machine can suspend when no activity is detected for x minutes, then when an inference request is received it can wake up, restore OS state from memory and inference \n\n- This allows for low idle power (suspend power cost) but fast interactivity (\\~5-10 seconds to get back to ready to infernece stage)\n```\n\nHowever my board the ASRock WRX80D8-2T unfortunately does not support S3 sleep, the BIOS has an “S3 Support for 3DS RDIMM & LRDIMM” option but it seems despite enabling this S3 sleep is not functional:\n\n$ cat /sys/power/mem_sleep\n\ns2idle\n\nWhen suspending with S2idle, power draw immediately spikes to 1000-1100W and stays like that until I unsuspend the system, not sure why that would be. Because of this I’ve investigated other ways to reduce idle cost, one sucess I had was auto suspending my 5 GPUs with runtime pm, with this the GPUs now suspend after 30 seconds of inactivity, which means the new idle power draw is ~100W, 3.5x the original number but still not as theoretically low as what S3 sleep would give me. This does mean when I go to use my gpus there is a slight delay where the GPUS need to wake up and reread model weights before I start seeing inference but this is generally > 10 seconds and is worth the 3x idle power draw.\n\nMy next option is S4 or Hibernate, I set a 1tb drive as my swap target and tested hibernate with:\n\necho test_resume | sudo tee /sys/power/disk\n\necho disk | sudo tee /sys/power/state\n\nIt failed at the AMDGPU freeze/quiesce stage. The screen/log showed errors like:\n\nMES failed to respond to msg=REMOVE_QUEUE\n\nfailed to unmap legacy queue\n\nsuspend of IP block  failed -22\n\npci_pm_freeze(): amdgpu_pmops_freeze returns -22\n\nPM: failed to quiesce async: error -22\n\nPM: hibernation: Failed to load image, recovering.\n\nRight now I remote power on and off my server via ipmitool whenever I need to use it/dont need to use it, server boot time is about 2:23, then I have my model of choice (Qwen3.5-397B IQ4_XS ~230GB) auto load via llama-swap, model load takes about 1:35. So the total time between power on and inference start is about ~4 minutes which makes it less usable for sporadic questions (as is my primary use) and when I’m on the go.\n\nI’m hoping some of the incredibly knowledgeable folks here may have encountered a similar conundrum or even somehow hacked in S3 (I’ve seen that it has been done but its very buggy) and were able to get lower idle draw while still retaining somewhat fast “ready to go” times.\n\nAny advice is appreciated greatly", "url": "https://wpnews.pro/news/reducing-wrx80-server-idle-power", "canonical_source": "https://forum.level1techs.com/t/reducing-wrx80-server-idle-power/251518#post_8", "published_at": "2026-09-07 21:03:58+00:00", "updated_at": "2026-09-07 21:31:07.459100+00:00", "lang": "en", "topics": ["ai-infrastructure"], "entities": ["ASRock WRX80D8-2T", "AMD Threadripper PRO 3995WX", "AMD Radeon Pro W7900", "Linux Mint 22.3", "llama.cpp", "Qwen3.5-397B", "llama-swap", "ipmitool"], "alternates": {"html": "https://wpnews.pro/news/reducing-wrx80-server-idle-power", "markdown": "https://wpnews.pro/news/reducing-wrx80-server-idle-power.md", "text": "https://wpnews.pro/news/reducing-wrx80-server-idle-power.txt", "jsonld": "https://wpnews.pro/news/reducing-wrx80-server-idle-power.jsonld"}}