WebLLM in Production: Cold Starts, Service-Worker Blocking, and the Missing 14B WebGPU Build
An engineering team evaluated WebLLM 0.2.87 as a way to run an in-editor code assistant entirely in the browser, measuring cold starts, service-worker blocking, and model availability beyond the paper's decoding-throughp…