17:51
2026-09-23
github.com
ai-infrastructure
Show HN: Reflex – a GGUF/CUDA inference engine tuned for cold-start latency
Lateos AI released Reflex, an open-source GGUF-native Rust and CUDA inference engine that compiles every CUDA kernel ahead-of-time with nvcc at build time to eliminate the multi-second JIT tax on firs…