{"slug": "openai-uses-codex-to-keep-chatgpt-fast", "title": "OpenAI uses Codex to keep ChatGPT fast", "summary": "OpenAI cut ChatGPT's p99 latency by roughly 30% using an automated, Codex-driven \"performance factory\" that continuously profiles, patches and redeploys production code, the company said in a post on its website. OpenAI said the system runs 24/7 so that each new model version or dependency update receives the same treatment, reducing surprise regressions and manual tuning. The company framed the result as allowing larger models or denser prompts without hitting the same latency wall, or keeping the same SLOs while cutting 20–30% off the inference cloud bill.", "body_md": "[OpenAI](https://openai.com/index/how-openai-performance-factory-keeps-chatgpt-fast)\n\n### OpenAI uses Codex to keep ChatGPT fast\n\nWhich summary reads better? Pick one — models revealed after.Both summaries are AI-generated.\n\nOpenAI cut ChatGPT’s p99 latency by ~30% using an automated, Codex-driven performance factory that continuously profiles, patches, and redeploys production code. This means you can now ship larger models or denser prompts without hitting the same latency wall, or you can keep the same SLOs while shaving 20–30% off your inference cloud bill. The factory runs 24/7, so every new model version or dependency update gets the same treatment—expect fewer surprise regressions and less manual tuning.\n\nOpenAI's Performance Factory leverages Codex-powered workflows to automatically detect and resolve performance bottlenecks in ChatGPT, reducing latency and improving response times. This ensures more reliable and scalable deployment of LLMs in production environments.", "url": "https://wpnews.pro/news/openai-uses-codex-to-keep-chatgpt-fast", "canonical_source": "https://www.snipvote.com/story/cmwonn1wg0004zztmuirezsjl", "published_at": "2026-11-20 07:42:49.323874+00:00", "updated_at": "2026-11-20 07:42:51.599526+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-infrastructure", "ai-tools", "mlops"], "entities": ["OpenAI", "ChatGPT", "Codex", "Performance Factory"], "also_reported_by": [], "takeaway": "An automated Codex-driven pipeline that continuously profiles, patches and redeploys production code cut ChatGPT's p99 latency by about 30%, letting OpenAI run larger models or denser prompts at the same latency or trim 20–30% from inference costs.", "recommendation": {"advice": "Automate continuous profiling and patching of production LLM serving code so every model version and dependency update is re-tuned; OpenAI's Codex-driven factory cut p99 latency ~30% this way.", "playbook": "production-ops", "playbook_url": "https://wpnews.pro/playbooks/production-ops"}, "alternates": {"html": "https://wpnews.pro/news/openai-uses-codex-to-keep-chatgpt-fast", "markdown": "https://wpnews.pro/news/openai-uses-codex-to-keep-chatgpt-fast.md", "text": "https://wpnews.pro/news/openai-uses-codex-to-keep-chatgpt-fast.txt", "jsonld": "https://wpnews.pro/news/openai-uses-codex-to-keep-chatgpt-fast.jsonld"}}