00:00
2026-09-17
nobodywho.ai
large-language-models
LLM inference vs. the OOM killer
The open-source Rust inference library behind the NobodyWho Chat test app can register for OS memory-warning signals to automatically unload LLM models before Android and iOS Out Of Memory killers ter…