14:40
2026-07-14
github.com
large-language-models
Show HN: Low-latency local LLM runner via OpenJDK Panama FFM (Java 22)
David released libargus, a low-latency local LLM runner that uses OpenJDK Panama FFM to interface directly with llama.cpp and whisper.cpp from the JVM, achieving zero-allocation on hot paths. The projβ¦