22:31
2026-09-24
pub.towardsai.net
ai-infrastructure
OpenAI Prompt Cache Diagnostics: Find the Prefix Drift Making Your AI App Expensive
OpenAI has introduced Prompt Cache Diagnostics in the Responses API for GPT-5.6 and later supported models, letting teams compare a current response against a recent baseline via prompt_cache_options.…