FrugalGPT

A developer introduced Model Cascade, a technique that uses a cheap model's confidence scores to decide when a large, expensive LLM is needed for classification tasks, potentially reducing costs signi…

A new arXiv paper introduces InflationAgent, a four-stage router that accounts for token inflation—the ratio of true workflow cost to single-call cost—which can exceed 2x on difficult tasks. The syste…

Avriz, a cloud platform for coding agents, has built a contextual bandit system that learns to route LLM calls to the cheapest capable model without risking user experience. The system trains exclusiv…