A new Swift tutorial demonstrates how to run large language models directly on iOS and macOS devices using the NobodyWho library, which wraps llama.cpp in Rust and provides a clean Swift API. The tuto…
NobodyWho, an open-source project providing a Rust core for on-device LLM inference via llama.cpp, announced support for Expo, enabling developers to run large language models entirely on users' phone…
A benchmark of Gemma4-E4B on an AMD Ryzen 7040 CPU shows that using 8 threads instead of 16 improves prompt processing from 94.66 to 105.94 tokens per second and token generation from 11.64 to 16.15 t…
NobodyWho announced speech support in its on-device inference engine, adding Text to Speech (TTS) via Kokoro, Pocket TTS, and Supertonic, and Speech to Text (STT) via Whisper, all running on ONNX Runt…
NobodyWho released NobodyWho Chat, a fully offline AI assistant for iOS and Android that runs open-weight models locally on the device, ensuring no data leaves the phone and no internet connection is …
NobodyWho has released the world's first standalone Apple Watch app that runs AI models locally and offline without requiring an iOS companion app. The app supports small language models like Prism ML…
NobodyWho released Kotlin bindings for its on-device LLM inference engine, allowing Android and JVM developers to add the library as a Gradle dependency and run models entirely on users' devices witho…