OpenRouter launched a Batch API that lets providers complete bundled inference requests anytime within a 24-hour window in exchange for charging roughly 50% or less of normal per-token pricing, availa…
Anthropic's Claude Sonnet 5 introductory pricing ends August 31, with rates rising 50% on September 1 to $3 per million input tokens and $15 per million output tokens, but the new tokenizer generates …
An engineer built an AI pipeline for a job platform that processed 10,000 daily listings, but the project was shut down when the API bill reached $3,000 per month for a single feature. The developer l…
ZeroGPU released a Batch API that enables overnight tagging of customer reviews using a small, efficient model (LFM2.5-1.2B-Instruct) instead of expensive frontier LLMs. The API processes thousands of…
Zep launched the Batch API for loading large datasets into agent memory, supporting batches up to 50,000 items with a progress dashboard and no impact on real-time ingestion. The API replaces earlier …
Anthropic's Batch API can cut Claude AI costs by 50% for asynchronous workloads, according to a developer at CitizenApp. The team reduced their monthly Claude bill from approximately $8,000 to $4,000 …
A developer has released a free tool that tracks token spending in Claude Code sessions, alongside a paid kit containing 18 cost-reduction tactics. The free component includes a read-only script that …
ZeroGPU has launched a Batch Processing API for asynchronous AI workloads, allowing developers to upload JSONL files for batch jobs and retrieve results upon completion. The new feature supports large…
Two new service tiers for the Gemini API: Flex and Priority. Flex offers a 50% cost reduction for latency-tolerant background tasks, while Priority provides the highest reliability for critical, user-…