A developer has built a privacy-first drug interaction checker that runs entirely in the browser using WebGPU and WebLLM, eliminating the need to send sensitive medical data to remote servers. The too…
A developer has launched Buttercup, an open-source project demonstrating AI agents built entirely in client-side JavaScript that run in the browser, aiming to reduce infrastructure costs by eliminatin…
Charlie F. Ruan leads WebLLM, an open-source runtime that uses WebGPU, WebAssembly, and compiler-generated artifacts to run language models locally in a browser without an inference server. WebLLM, pu…
WebLLM, an open-source library from MLC AI, enables running large language models like Llama 3, Mistral, and Phi-3 directly in the browser via WebGPU, eliminating server-side latency and data privacy …
MLC AI's WebLLM is a high-performance in-browser LLM inference engine that runs entirely in web browsers with WebGPU hardware acceleration, eliminating the need for server-side processing. It is fully…
An emerging architecture enables large language models to run directly in web browsers via WebGPU, shifting inference from cloud servers to user devices. The open-source WebLLM engine provides an Open…
Running an LLM in a browser tab without an API key or cloud bill is now possible, but users must verify the model file, browser exposure, and data leakage before trusting it with private documents. We…
WebGPU is now enabled by default in every major browser, making in-browser LLM inference a deployable tier, according to a tutorial on dev.to that builds a health-log analyzer running Llama-3-8B entir…
A developer has created a privacy-first health log analyzer that runs Llama-3-8B locally in the browser using WebLLM and WebGPU, ensuring no personal health information leaves the device. The system c…
A developer has built a local-first mental health assistant using WebLLM, TVM Unity, and React, which runs Llama 3 models directly in the browser via WebGPU. The assistant, designed for Cognitive Beha…
A new Chrome extension called Explain This lets users select text on a page, right-click, and get a plain-language explanation from a local LLM running entirely in the browser via WebGPU, with no serv…
A developer built a private, local mental health AI assistant using WebLLM and React, running Llama-3-8B directly in the browser via WebGPU to ensure sensitive data never leaves the user's device. The…
Tenclicker is a new browser-based clicker game that uses a WebLLM AI running locally via WebGPU to generate custom games from user prompts, with no server or API key required.…
A developer built a private health consultation bot that runs entirely in the browser using WebLLM and WebGPU, eliminating the need for backend servers and ensuring zero data leakage. The system execu…
A developer built a free AI grammar checker that runs entirely in the browser, using DeepSeek's API for grammar checking and local computation for readability stats. The tool, called AI Grammar Checke…
WebGPU feature detection proved insufficient for running small LLMs on phones. On an iPhone 11 Pro Max, all runs failed due to page reloads or load errors, while a Pixel 8a in LINE's in-app browser st…
A developer built a roguelike game where the dungeon master is a large language model that runs entirely in the player's browser using WebLLM and WebGPU, eliminating server costs and enabling offline …
A developer released Ghostty Playground, an experimental project that runs the full Ghostty terminal with a real Linux-like backend directly in the browser via BrowserPod, supporting configs, AI model…