cyankiwi

mentions 2 type Organization feed RSS

// recent coverage 2 mentions

09:02

2026-08-18

dev.to

large-language-models

I got Qwen3.8-27B running on dual RTX 3090s (no NVLink) under WSL2 — every pitfall I hit

A developer detailed the process of running Qwen3.8-27B on dual RTX 3090s without NVLink under WSL2, achieving 170-210 tok/s on code/JSON. The setup required specific CUDA 13.0 toolchain, SGLang 0.5.1…

19:13

2026-06-20

gist.github.com

large-language-models

Running GLM-5.2 (753B DeepSeek-Sparse-Attention MoE) on 8x A100 80GB with vLLM — TRITON_MLA_SPARSE backend (PR #38476), no-recompile install, benchmarks

A developer confirmed that GLM-5.2, a 753B-parameter DeepSeek-Sparse-Attention MoE model, runs on 8x A100 80GB GPUs using vLLM PR #38476, which adds a Triton sparse-MLA backend for Ampere architecture…

// co-occurs with top 8 entities

vLLM 2 GLM-5.2 1 DeepSeek 1 A100 1 Triton 1 AWQ 1 haosdent 1 Qwen3.8-27B 1

// topics top 4 topics

large language models 2 developer tools 2 artificial intelligence 1 ai infrastructure 1