{"slug": "rtx-pro-4500-x4-or-a100-40gb-x4-decision-in-the-morning", "title": "RTX Pro 4500 x4 or A100 40GB x4 (decision in the morning)", "summary": "A user comparing GPU options for AI inference and training reports that four RTX 5080 cards offer the best cost-performance compromise for a 64 GB memory target, outperforming two RTX 4500 cards at lower cost per GB, while noting the A100 40GB has higher memory bandwidth but lower relative performance than the RTX 3090.", "body_md": "I am currently in a similar position deciding on what GPUs I choose for the future.\n\nI made a spreadsheet to compare all the options. Prices are from Ebay in Euro and may change daily. But they give a ballpark at least.\n\nOf course, I didn’t include the A100 yet. But regarding performance indicator of Techpowerup it would be relative 78, well below the reference RTX3090 with 100 and the RTX4500 with 137. On the other side internal memory bandwidth is nearly twice as high, which is good for inference. So I would assume that inference performance is similar. But the A100 would certainly win regarding training.\n\nSo there may be additional factors:\n\nFor me there are fewer variables. I have a EPYC system with 7 slots and need no extra switch. As I am on a lower budget I target 64 GB memory and will probly choose 4x RTX5080 as best compromise. Cost per GB and per performance is lower than for 2x RTX4500. And 4x RTX5080 has about twice the performance than 2x RTX4500. I would buy the 4500 only in the single-slot version. YMWV.\n\nCurrently I run Qwen 27B Q6 with tensor split on a RTX4080 and an old RTX6000 Quadro with 30 - 50 t/s. I hope to double this at least. The speed should be above an RTX5090 or even a RTX6000 Blackwell, but for much less money.", "url": "https://wpnews.pro/news/rtx-pro-4500-x4-or-a100-40gb-x4-decision-in-the-morning", "canonical_source": "https://forum.level1techs.com/t/rtx-pro-4500-x4-or-a100-40gb-x4-decision-in-the-morning/253894#post_8", "published_at": "2026-08-19 22:57:26+00:00", "updated_at": "2026-08-19 23:14:09.362544+00:00", "lang": "en", "topics": ["ai-infrastructure"], "entities": ["NVIDIA RTX 5080", "NVIDIA RTX 4500", "NVIDIA A100 40GB", "NVIDIA RTX 3090", "NVIDIA RTX 4080", "NVIDIA RTX 6000 Quadro", "Qwen 27B"], "alternates": {"html": "https://wpnews.pro/news/rtx-pro-4500-x4-or-a100-40gb-x4-decision-in-the-morning", "markdown": "https://wpnews.pro/news/rtx-pro-4500-x4-or-a100-40gb-x4-decision-in-the-morning.md", "text": "https://wpnews.pro/news/rtx-pro-4500-x4-or-a100-40gb-x4-decision-in-the-morning.txt", "jsonld": "https://wpnews.pro/news/rtx-pro-4500-x4-or-a100-40gb-x4-decision-in-the-morning.jsonld"}}