What’s the cheapest way to get a high scaling efficiency tensor parallel rig for 8 GPUs?
An 8-GPU tensor-parallel (TP8) rig should prioritize PCIe topology over CPU choice, according to guidance recommending that GPUs communicate directly through a Gen5 switch rather than routing peer-to-peer traffic through…