{"slug": "does-anyone-have-experience-working-with-rocm-and-cuda-on-the-same-machine", "title": "Does anyone have experience working with ROCm and CUDA on the same machine?", "summary": "A user with an AMD RX 7900 XT is considering adding lower-end Nvidia RTX GPUs to run multiple local AI models on different cards, but is concerned about potential issues with running ROCm and CUDA side-by-side. The user asks whether there are material limitations beyond setup inconvenience, planning to put a mid-tier model on the 7900 and lower-tier models on the RTXs.", "body_md": "I have a RX 7900 XT in my machine and might be able to get one or two lower end RTXs.\n\nI have been experimenting with running models locally and thought it would be interesting to try and load multiple models on different gpus and route between them.\n\nHowever, here and there I read that heterogeneous hardware can be a real headache (eg, using ROCm and CUDA side-by-side) and that it should be avoided. (I don’t actually have a link to where I read this, it has been just in passing and that was the impression I got.)\n\nI get having all the various tools installed and needing to set things up to work with both are extra steps, but is there a material limitation or disadvantage to doing this? Something beyond annoyance or inconvenience?\n\nI’m interested this for the sake of knowing, but for added context my current plan is to put a mid-tier model on my 7900 and then lower tier models on the RTXs.", "url": "https://wpnews.pro/news/does-anyone-have-experience-working-with-rocm-and-cuda-on-the-same-machine", "canonical_source": "https://forum.level1techs.com/t/does-anyone-have-experience-working-with-rocm-and-cuda-on-the-same-machine/254474#post_1", "published_at": "2026-08-26 20:39:33+00:00", "updated_at": "2026-08-26 20:50:02.579419+00:00", "lang": "en", "topics": ["ai-infrastructure", "ai-tools"], "entities": ["AMD", "Nvidia", "ROCm", "CUDA", "RX 7900 XT", "RTX"], "alternates": {"html": "https://wpnews.pro/news/does-anyone-have-experience-working-with-rocm-and-cuda-on-the-same-machine", "markdown": "https://wpnews.pro/news/does-anyone-have-experience-working-with-rocm-and-cuda-on-the-same-machine.md", "text": "https://wpnews.pro/news/does-anyone-have-experience-working-with-rocm-and-cuda-on-the-same-machine.txt", "jsonld": "https://wpnews.pro/news/does-anyone-have-experience-working-with-rocm-and-cuda-on-the-same-machine.jsonld"}}