cd /news/ai-infrastructure/trying-hybrid-inference-gpu-cpu-with… · home › topics › ai-infrastructure › article
[ARTICLE · art-129684] src=forum.level1techs.com ↗ pub= topic=ai-infrastructure verified=true sentiment=↑ positive

Trying hybrid inference (GPU+CPU) with 200-400B models

A user running hybrid GPU+CPU inference on 4x Nvidia V100 GPUs reported beating an Nvidia RTX 5090 in token generation (TG) for Qwen 3.8 27B and outperforming two DGX Spark systems with Qwen 3.8 Flash Next, according to a post on X by jkyamog. The report covers hybrid inference experiments with 200-400B models.

read1 min views3 publishedSep 15, 2026

Some updates, been running on 4x V100 so far its been beating in TG the 5090 for Qwen 3.8 27B

I have been using it more for Qwen 3.8 Flash Next, beats x2 DGX Spark.

https://x.com/jkyamog/status/2096954517984346459?s=20

source & further reading
forum.level1techs.com — original article Alternative 400gb/s switch for 4 dgx spark cluster? What do we think of Unsloth? Wendel feel free to Chime in lol Share one NVIDIA GPU between a Linux host and Linux VMs, without VFIO passthrough
── more in #ai-infrastructure 4 stories · sorted by recency
── more on @nvidia v100 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/trying-hybrid-infere…] indexed:0 read:1min 2026-09-15 · —