# A lawyer spent $9,450 on 12 used NVIDIA V100 cards to hold every DeepSeek V4.1 Flash expert in GPU memory

> Source: <https://dev.to/delimitter/a-lawyer-spent-9450-on-12-used-nvidia-v100-cards-to-hold-every-deepseek-v41-flash-expert-in-gpu-4d34>
> Published: 2026-11-21 23:00:13+00:00

**Recommendation:** When serving MoE models on memory-bound older GPUs, keep experts at 4-bit and unpack in software rather than compressing further; the builder halved first-token time at 256K context by fitting all experts in HBM.
More in the playbook "Inference and self-hosting": <https://wpnews.pro/playbooks/inference-serving>

**📅 November 20, 2026 • Tom's Hardware**

A lawyer who posts on r/LocalLLM as Nick Mermiges has expanded his home AI server from eight to twelve used NVIDIA Tesla V100 32GB cards, adding a third NVLink board of four GPUs. Per his post and GitHub write-up, covered by Tom's Hardware on November 20, 2026, the whole build cost **$9,450**. The machine now runs **DeepSeek V4.1 Flash** with all 15,360 routed experts resident in memory at **4-bit NVFP4**, and his repo notes none of them were compressed further.

The memory math explains the third board. Eight 32GB cards offered about 254 GiB, while the NVFP4 experts alone need 278.9 GiB across 40 layers, per the builder's notes. Twelve cards lift total HBM2 memory to **384 GiB**, so the full expert set fits without further shrinking. Before, he ran every expert at 2-bit precision and moved only the 5,949 most-used ones, about 38.7 percent, to NVFP4 until the slots filled.

There is a catch in where the speed comes from. The V100 dates to 2018, and its Volta chips have no FP4 or FP8 tensor cores, so every NVFP4 number is unpacked in software into half precision before use. Per Mermiges, the benefit appears because the cards read fewer bytes, not because they compute faster, and he writes that expert values equal the ones in DeepSeek's own release while other parts of the model use compact forms.

All performance figures here are self-reported by the builder. Per Mermiges, code generation reaches **up to 184 tokens per second** on a single stream, and long documents start answering in **about half the time** versus the previous eight-card build, which he calls the main improvement. He reports the first code token at 256K context in 58 seconds versus 108.4 seconds before, and prompt reading above 32K context at about 4,500 tokens per second versus 2,200 on the first build.

The limits are stated honestly. Code decoding is **23 percent** faster at 1K context per his write-up, but he sees no real gains at 32K context and above. Reading a 128K file takes 28 seconds and a 256K file takes 185 seconds, and three parallel requests at 128K yield about 360 tokens per second on code or 213 on legal documents, per Mermiges.

He also says the machine beats published **four-unit DGX Spark stacks** at single-request decoding, by 15 to 45 percent on code, at about half the price of a three-unit Spark setup. Tuning helped too. He raised the power cap from 150 to 175 watts and lowered the clock cap from 1,522 to 1,452 MHz for a net performance gain, per his notes.

Why it matters. Discontinued 2018 silicon is running a 2026 model format through software workarounds, and the project shows budget local AI is often bound by memory bandwidth rather than compute. It remains a hobbyist machine with self-reported numbers, not an independent benchmark, and per his documentation the third board sits behind a separate PCIe switch whose second hop adds latency. For a lawyer reading long contracts locally, halving the wait for the first token may be worth every dollar of the $9,450.

Sources:

[https://tomshardware.com/tech-industry/artificial-intelligence/lawyers-usd9-450-private-ai-server-of-12-used-nvidia-v100s-now-runs-every-deepseek-v4-1-flash-expert-at-4-bit-nvfp4-up-to-184-tokens-per-second-on-code-and-long-documents-start-answering-in-about-half-the-time](https://tomshardware.com/tech-industry/artificial-intelligence/lawyers-usd9-450-private-ai-server-of-12-used-nvidia-v100s-now-runs-every-deepseek-v4-1-flash-expert-at-4-bit-nvfp4-up-to-184-tokens-per-second-on-code-and-long-documents-start-answering-in-about-half-the-time)

[https://mezha.net/eng/news/mezha-268801830767cbc0b0dce67c_lawyer-s_-9-450_server](https://mezha.net/eng/news/mezha-268801830767cbc0b0dce67c_lawyer-s_-9-450_server)

[https://ameriledger.com/article/lawyer-s-9-450-private-ai-server-with-12-used-nvidia-v100s-now-runs-every](https://ameriledger.com/article/lawyer-s-9-450-private-ai-server-with-12-used-nvidia-v100s-now-runs-every)

[https://urgent.news/2026/11/20/lawyers-9-450-private-ai-server-with-12-used-nvidia-v100s-now-runs](https://urgent.news/2026/11/20/lawyers-9-450-private-ai-server-with-12-used-nvidia-v100s-now-runs)

[https://technetbooks.com/2026/11/lawyer-builds-personal-ai-cluster-to.html](https://technetbooks.com/2026/11/lawyer-builds-personal-ai-cluster-to.html)

[https://gate.com/news/detail/lawyer-upgrades-private-ai-server-to-12-nvidia-v100-gpus-for-deepseek-v41-25752904](https://gate.com/news/detail/lawyer-upgrades-private-ai-server-to-12-nvidia-v100-gpus-for-deepseek-v41-25752904)

**Sources:**

**Continue the conversation:** [https://t.me/AIAutomationArchitecture](https://t.me/AIAutomationArchitecture) · [Bluesky](https://bsky.app/profile/delimitter.bsky.social)
