cd /news/large-language-models/leaderboard-by-hardware · home › topics › large-language-models › article
[ARTICLE · art-165880] src=overbring.com ↗ pub= topic=large-language-models verified=true sentiment=· neutral

Leaderboard by hardware

A hardware-grouped benchmark leaderboard published by an unnamed benchmarking site ranks local model runs by the exact GPU, PCIe and RAM configuration used, so readers can match a model to their own hardware. On a PCIe 5.0 x8/x8 setup of two RTX 5060 Ti 16GB cards, Ornith 1.5 35B-A3B NVFP4 posted 2340 tokens/s prompt processing and 112 tokens/s generation at 178 s wall time with a 4/5 quality score, while Nemotron-3.5-Bolt-74B-A9B IQ2 QAT reached 1280 PP and 107.9 TG at 284.8 s and also scored 4/5. The board notes that tensor versus layer split mode depends on the motherboard's PCIe topology when more than one GPU is involved.

by read1 min views2 publishedOct 29, 2026
Leaderboard by hardware
Image: Overbring (auto-discovered)

Best Elixir runs per hardware.

This board groups model benchmarking runs by hardware, i.e. the exact GPUs, PCIe lanes and RAM they run on, so you can pick the model that best matches the hardware you have. Split mode (tensor or layer) depends on the PCIe topology of the motherboard, if more than one GPU is involved.

PCIe 3.0 x16

Model Quant Wall PP TG Needle Quality
Ornith-1.5-35B-A3B MiniPlus V2.1 APEX-I MiniPlus V2.1 1227.33 s 819.65 57.92 hit 2/5

PCIe 4.0 x16 (CPU) + 4.0 x4 (PCH)

Model Quant Wall PP TG Needle Quality
Groot-19B-A3B-261023 MTP Q5_K_M 227.7 s 2496 80.2 hit 2/5

PCIe 5.0 x8/x8

Model Quant Wall PP TG Needle Quality
Nemotron-3.5-Bolt-74B-A9B IQ2 QAT IQ2 QAT 284.8 s 1280 107.9 hit 4/5
Muse-Glimmer NVFP4 NVFP4 113.4 s 1224 74.9 hit 4/5
Ornith 1.5 35B-A3B NVFP4 NVFP4 178 s 2340 112 hit 4/5
flint NVFP4 NVFP4 371.5 s 815 84.9 cliff 2/5
LFM2.5-24B-A2B Q8_0 Q8_0 135.2 s 1403 151 hit 2/5

A paragraph about what you are working on is enough to start.

source & further reading
overbring.com — original article How to run Groot-19B-A3B-261023 MTP on RTX 4070 SUPER + RTX 4060 Ti How to run flint NVFP4 on 2× RTX 5060 Ti 16 GB How to run LFM2.5-24B-A2B Q8_0 on 2× RTX 5060 Ti 16 GB
── more in #large-language-models 4 stories · sorted by recency
── more on @ornith-1.5-35b-a3b miniplus v2.1 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/leaderboard-by-hardw…] indexed:0 read:1min 2026-10-29 · —