AI Gateway now supports WebSocket mode for the OpenAI Responses API. You can keep a persistent connection open and continue each turn by sending only new input items plus previous_response_id
, instead of re-sending the full context over a fresh HTTP request every turn.
OpenAI reports up to ~40% faster end-to-end execution on WebSockets for agentic rollouts with 20 or more tool calls.
The Responses route opens at GET /v1/responses
and accepts raw response.create
frames over a persistent WebSocket connection. The mode is compatible with store=false
and Zero Data Retention, and follows OpenAI's WebSocket mode specification upstream.
See the AI Gateway documentation for setup and the full route list.
source & further reading
vercel.com — original article
Run Claude Managed Agents with Chat SDK
Kimi K3 and Kimi K3 Fast with ZDR and US-based providers now on AI Gateway
Claude Opus 5 now available on AI Gateway