{"slug": "xai-grok-audio-models-now-available-on-vercel-ai-gateway", "title": "xAI Grok audio models now available on Vercel AI Gateway", "summary": "XAI's Grok audio models, including real-time voice, text-to-speech, and speech-to-text, are now available on Vercel's AI Gateway. Developers can integrate these capabilities via the AI SDK 7, with features like token-based authentication and browser hooks for voice agents. The models are also accessible through the AI Gateway playground for direct testing.", "body_md": "[xAI's audio models](https://vercel.com/ai-gateway/models?capabilities=realtime&providers=xai) are now live on AI Gateway. Realtime voice, text to speech, and speech to text are all available through the [AI SDK](https://ai-sdk.dev/v7/docs/ai-sdk-core/realtime) with the same routing, observability, and spend controls as your other models.\n\nThese capabilities are available on the AI SDK 7 release.\n\nCapability | Models |\n|---|---|\n|\n|\n|\n|\n|\n|\n\nA voice agent has two pieces: a server route that mints a short-lived token, so your API key never reaches the client, and a browser component that connects with it.\n\nAdd the token route: this example sets [model](https://vercel.com/ai-gateway/models/grok-voice-think-fast-1.0) to `xai/grok-voice-think-fast-1.0`\n\n:\n\nThen connect from the browser. The `useRealtime`\n\nhook from `@ai-sdk/react`\n\nfetches that route and manages the WebSocket connection, microphone capture, and audio playback:\n\nGenerate [spoken audio](https://vercel.com/ai-gateway/models/grok-tts) from text with `generateSpeech`\n\n. Pass a voice and an output format, then write the result to a file with `xai/grok-tts`\n\n:\n\n[Transcribe](https://vercel.com/ai-gateway/models/grok-stt) recordings into text with `transcribe`\n\n. This example uses `xai/grok-stt`\n\n:\n\nYou can also try the xAI audio models directly in the AI Gateway playground. Open the [models list](https://vercel.com/ai-gateway/models) and click into any of the models to use them directly in the browser. The `xai/grok-voice-think-fast-1.0`\n\nplayground [here](https://vercel.com/ai-gateway/models/grok-voice-think-fast-1.0) allows you to talk to the agent and see responses instantly:", "url": "https://wpnews.pro/news/xai-grok-audio-models-now-available-on-vercel-ai-gateway", "canonical_source": "https://vercel.com/changelog/xai-grok-audio-models-now-available-on-vercel-ai-gateway", "published_at": "2026-06-29 00:00:00+00:00", "updated_at": "2026-06-29 17:19:18.912080+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-products", "ai-tools", "ai-infrastructure", "developer-tools"], "entities": ["xAI", "Vercel", "AI Gateway", "AI SDK", "Grok"], "alternates": {"html": "https://wpnews.pro/news/xai-grok-audio-models-now-available-on-vercel-ai-gateway", "markdown": "https://wpnews.pro/news/xai-grok-audio-models-now-available-on-vercel-ai-gateway.md", "text": "https://wpnews.pro/news/xai-grok-audio-models-now-available-on-vercel-ai-gateway.txt", "jsonld": "https://wpnews.pro/news/xai-grok-audio-models-now-available-on-vercel-ai-gateway.jsonld"}}