Creating a custom homelab machine for LLM usage on a budget

A homelab builder running Mistral 7B and DeepSeek-R1 8B locally, and Mistral Large in the cloud, is comparing GPU options for a budget local LLM machine, primarily for software debugging. The listed prices are the Arc Pro B60 at about €900, the AMD Radeon R9700 32GB at about €1,800, the NVIDIA Tesla V100 at about €740, the W7800 32GB at about €2,200, and the RTX 3090 at about €1,400. The builder said the use case is still being determined.

With My current setup, I have Been using mostly Mistral 7b and deepseek-r1 8b. But in The cloud, mostly Mistral large. Currently mostly helping with software debugging The Arc Pro b60 is around 900e AMD Radeon R9700 32gb around 1800e NVIDIA Tesla v100 around 740e W7800 32gb around 2200rtx 3090 around 1400e And My apologies, still trying to figure out our use case.