I Thought the Model Drifted. My Cache Key Was Serving Tuesday.
A developer spent two days debugging an LLM endpoint that returned answers for the wrong prompts, initially blaming model drift and sampling noise. The root cause was a cache key that hashed only the …