{"slug": "vllm-launcher-windows-desktop-workbench-for-local-llms-vllm-sglang-llama-cpp", "title": "vLLM Launcher — Windows Desktop Workbench for Local LLMs (vLLM, SGLang, llama.cpp)", "summary": "VLLM Launcher, a Windows desktop app for managing local LLM inference through WSL2, has been released as v0.1.0-alpha. The app supports multiple engines including vLLM, SGLang, and llama.cpp, and provides an OpenAI-compatible and Anthropic-compatible API gateway. It is available as a portable Windows release (~31 MB) and is built with Go/Wails, React/TypeScript, and Node.js.", "body_md": "Hi everyone,\n\nI’m sharing a project I’ve been building: vLLM Launcher — a Windows desktop app for managing local LLM inference through WSL2.\n\nWhat it does:\n\nMulti-engine management: vLLM, SGLang, llama.cpp from one desktop UI\n\nLocal API gateway with OpenAI-compatible and Anthropic-compatible endpoints\n\nInstance cards for start/stop/restart/inspect workflows\n\nRequest logs, health checks, runtime metrics, and disk model discovery\n\nFloating mode for compact status while working in other apps\n\nWSL process orchestration that survives Node.js restarts\n\nTech stack:\n\nGo / Wails desktop shell\n\nReact + TypeScript frontend\n\nNode.js API service\n\nModel engines running inside WSL2\n\nDownload: Windows portable release (~31 MB, unzip and run)\n\nThis is the first public release (v0.1.0-alpha). Feedback and setup issues are especially welcome since I’m still refining the installation flow across different Windows/WSL/driver setups.\n\nWould love to hear from anyone running local models on Windows!", "url": "https://wpnews.pro/news/vllm-launcher-windows-desktop-workbench-for-local-llms-vllm-sglang-llama-cpp", "canonical_source": "https://discuss.huggingface.co/t/vllm-launcher-windows-desktop-workbench-for-local-llms-vllm-sglang-llama-cpp/178516#post_1", "published_at": "2026-08-09 02:57:24+00:00", "updated_at": "2026-08-09 12:38:40.651633+00:00", "lang": "en", "topics": ["ai-tools", "ai-infrastructure", "developer-tools"], "entities": ["vLLM Launcher", "vLLM", "SGLang", "llama.cpp", "WSL2", "Go", "Wails", "React"], "alternates": {"html": "https://wpnews.pro/news/vllm-launcher-windows-desktop-workbench-for-local-llms-vllm-sglang-llama-cpp", "markdown": "https://wpnews.pro/news/vllm-launcher-windows-desktop-workbench-for-local-llms-vllm-sglang-llama-cpp.md", "text": "https://wpnews.pro/news/vllm-launcher-windows-desktop-workbench-for-local-llms-vllm-sglang-llama-cpp.txt", "jsonld": "https://wpnews.pro/news/vllm-launcher-windows-desktop-workbench-for-local-llms-vllm-sglang-llama-cpp.jsonld"}}