cd /news/large-language-models/glm-5-3-flash-on-amd-gpus-670-tok-s · home › topics › large-language-models › article
[ARTICLE · art-142342] src=twitter.com ↗ pub= topic=large-language-models verified=true sentiment=↑ positive

GLM 5.3 flash on AMD GPUs 670 tok/s

GLM 5.3 Flash is now live on RunInfra running on AMD GPUs, delivering 670 tokens per second on the Vercel AI Gateway at $0.11 per 1M input tokens, $0.45 per 1M output tokens and $0.03 per 1M cached tokens with a 1M token context window. The vendor-native FP8 release keeps the same model and API while adding capacity, and reports a 99.7% cache hit rate over the last 24 hours with cache logs visible in the dashboard. The model supports OpenAI-compatible chat completions and Anthropic-compatible /v1/messages endpoints, text and image input, tool calling, JSON mode and streaming, with zero data retention and no training on customer data.

read1 min views2 publishedSep 30, 2026
GLM 5.3 flash on AMD GPUs 670 tok/s
Image: source

we spent september rewriting the kernels behind GLM 5.3 Flash. major release is live on RunInfra today 670 tok/s on Vercel AI Gateway $0.11 per 1M input, $0.45 per 1M output, $0.03 per 1M cached. 1M token context. FP8, vendor-native release it now runs on AMD. same model, same API, more capacity behind it 99.7% cache hit rate over the last 24 hours. every hit and miss shows up in your dashboard, so you can track the cache logs yourself OpenAI-compatible chat completions and Anthropic-compatible /v1/messages. text and image input, tool calling, JSON mode, streaming zero data retention. never used for training

source & further reading
twitter.com — original article
── more in #large-language-models 4 stories · sorted by recency
── more on @glm 5.3 flash 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/glm-5-3-flash-on-amd…] indexed:0 read:1min 2026-09-30 · —