# Post / Show off your Ai Rig - Whatchya got in there?

> Source: <https://forum.level1techs.com/t/post-show-off-your-ai-rig-whatchya-got-in-there/255709#post_3>
> Published: 2026-09-10 23:44:48+00:00

Oh, you wanna see my m~~e~~ath lab?

Epyc Rome 7532

128GB DDR4

Various NVMe totaling ~5TB of storage

4x AMD V620

All in an open air crypto-mining bench. No, this does not trip breakers, but it comes close.

Current stack is a LiteLLM frontend to vLLM (I’ll do a write-up on how I optimized vLLM soon), serving Qwen3.8-flash-next at int4 quant, with the n-gram table offloaded to system memory. Gets me ~70TPS of single-request inference and ~90TPS peak for 2-3 simultaneous streams. This is without MTP, because MTP is not reliably performant with multiple simultaneous requests being served. Still trying to figure that one out.
