03:27
2026-08-23
forum.level1techs.com
large-language-models
Running qwen 3.6 / 2.8 on 3090+3080 over RPC?
A user reports running Qwen 3 Coder 30B A3B, Qwen 3.6 27B, and Qwen 3.8 27B on a local machine with a 7800X3D, 64GB DDR5, and an RTX 3090 24GB, achieving about 70 tokens per second on Qwen 3.8 27B, an…