14:40
2026-07-14
github.com
large-language-models
Show HN: Low-latency local LLM runner via OpenJDK Panama FFM (Java 22)
David released libargus.cc, a low-latency local LLM runner that uses OpenJDK Project Panama's Foreign Function & Memory API (Java 22) to interface directly with llama.cpp, whisper.cpp, and ggml comput…