WebLLM, an open-source library from MLC AI, enables running large language models like Llama 3, Mistral, and Phi-3 directly in the browser via WebGPU, eliminating server-side latency and data privacy …
MLC AI's WebLLM is a high-performance in-browser LLM inference engine that runs entirely in web browsers with WebGPU hardware acceleration, eliminating the need for server-side processing. It is fully…
Meta and MLC AI have released LlamaFile, a portable binary format that bundles an entire large language model with its inference engine into a single executable file, enabling users to run 100+ open-s…
A developer built a roguelike game where the dungeon master is a large language model that runs entirely in the player's browser using WebLLM and WebGPU, eliminating server costs and enabling offline …
A developer released Ghostty Playground, an experimental project that runs the full Ghostty terminal with a real Linux-like backend directly in the browser via BrowserPod, supporting configs, AI model…