RightNow AI

RightNow AI open-sourced bonsai-turbo, a batch-1 decode engine that runs PrismML's Bonsai 27B ternary LLM 1.76x faster than the official llama.cpp fork on an H100, achieving 151 tok/s (ternary) and 15…

RightNow AI released Auto, a compiler that records LLM-agent behavior and compiles it into verified, capability-confined WASM binaries. The system uses a tiered runtime that falls back to a frontier m…