# Small dev team AI box suggestions

> Source: <https://forum.level1techs.com/t/small-dev-team-ai-box-suggestions/260803#post_2>
> Published: 2026-11-22 16:41:57+00:00

**Recommendation:** Serve the MoE model with vLLM on ROCm to batch concurrent office requests, and verify the R750's 12V-2x6 GPU power cables and Dell's validated-GPU list before buying R9700s.
More in the playbook "Inference and self-hosting": <https://wpnews.pro/playbooks/inference-serving>

Hello Fabio,

I’d go with the **two R9700s**. You get **32GB** on each card, ROCm officially supports them on Linux, and the blower coolers push the heat straight out the back, which is what you want in a 2U box. At 300W each, they’re also within what Dell lists for the R750’s two double-wide GPU slots.

You’re right to lean toward MoE. AMD’s ROCm blog lists Qwen3.5 35B-A3B at 20.5GB at Q4, so it fits on one card with plenty of room for context, and you’d still have the second card if you want something bigger later. Since the whole office will be using it, I’d serve it with vLLM on ROCm, which batches everyone’s requests together instead of making people wait in line.

One thing to check before you order: Dell’s manual says not to install GPUs it hasn’t validated, and the R9700 isn’t on their R750 list. The card also uses a **12V-2x6** power connector, so make sure the R750’s GPU power cables can actually feed it. If they can’t, a workstation tower might be the easier home for the cards.

Good luck with the build!
