My Home AI's First Reply Took Four Minutes. Now It Takes Eleven Seconds.
Nova, a home AI running locally in France, reduced its first-reply latency from 242 seconds to 11 seconds by disabling unused tool schemas, caching the prompt per session, and moving cold starts to a 6 AM warm-up. The pr…