11:34
2026-09-02
dev.to
developer-tools
A rate limit that counts the tokens you asked for, not the ones you got
A developer discovered that Groq's free tier rate limit counts the declared max_tokens rather than actual generated tokens, causing requests with small prompts but large max_tokens values to be reject…