LLMlet: P2P distributed LLM inference on browsers
LLMlet, an experimental open-source tool, enables distributed large language model inference across web browsers using WebRTC and Wasm-compiled llama.cpp. Users can connect multiple browser tabs as pe…