Show HN: Deadline aware router with no fees

Adi launched FlexInference, a deadline-aware AI inference router that cuts costs by up to 45% by finding cheaper providers within user-specified SLAs, charging only a 20% fee on savings with no per-request fees. The service runs on Cloudflare Workers across 300+ cities, promises zero data storage, and works with existing OpenAI, Anthropic, and Gemini clients.

A router that drops cost by 45% We find cheaper inference within the SLA you provide. // median cost and latency across 24,458 requests Some of the ways you can drop your costs by half Built so you aren't debugging at 2am 3 ms routing across 300 cities. When you make a request it is fulfilled using edge compute. We use Cloudflare workers which is deployed in 300+ cities. Our own routing adds 1-5 milliseconds on a cold start. Your prompts are never stored or read. Your prompt and its reply just pass through. We never store them and we never read them. Your provider key is envelope-encrypted with AES-256-GCM and locked to your exact org and provider slot, so it decrypts nowhere else, and a key that will not decrypt is treated as missing. So your production key is safe to drop in. Your discounts, credits, and API tiers stay yours. You bring your own key, so the provider bills you directly. We also don't have a fee per request. By bringing your own key you also get the benefits of using your credits, discounts, negotiated rates, and API tiers. We fail fast and loud. If you send a wrong parameter we don't quietly strip it to force a success. When the provider rejects a request, we send the status code and the error back to you. That way you can debug based on your intentions and not find a bug weeks after launching. Your existing client works unchanged. Point the base URL at us and pass your key. We work with OpenAI, Anthropic, and Gemini clients. To use FlexInference you just need to add a single new field, start within. If you decide to use our Python or TypeScript SDKs then you also get the benefits of strict types. Errors your agent can fix itself. Every error comes back in the shape of the SDK you called, so your client parses it unchanged. It carries a machine-readable code, the exact fix, and a doc url. Our MCP server goes further. Coding tools like Claude and Cursor can search the docs, look up any error code, and manage your keys over OAuth. So your agents fix their own mistakes, and you are not stuck babysitting them. Only pay when we save you money. Base price - No fee per standard request - No sales call - No seats or tiers - No trial Routing is free. When you give us an SLA to find a cheaper way to run your request, we hunt for cheaper inference. If we find you cheaper inference, we keep 20% of what we save you. If we cannot find anything cheaper, we escalate your request to a standard request and it is once again free. If we take a $10 request down to $5, we take a $1 fee and you pay $6. That is 40% savings. CLICK TO ACTION /login this takes you to login/signup No new SDK semantics to learn. Point your base URL at FlexInference, pass your FlexInference key, and add start within to start saving. curl https://api.flexinference.com/v1/responses \ -H "Authorization: Bearer flex live ..." \ -H "Content-Type: application/json" \ -d '{ "model": "gpt-5.2", "input": "Summarize this thread.", "start within": "00h-00m-30s" }' Why I built FlexInference? Hey My name is Adi. I grew up wanting to help others. Actually, that's not always been true. I went through a tough time in college and it made me want to help people. Help people get educated. Help people get better healthcare. Help people with the basics, you know? At first I tried to do that directly. Made a few free websites/tools/videos. And it definitely helped. But, not the scale I wanted. Then AI hit an inflection point. It started making education better because it could answer a billion questions happily. It made healthcare better by personalizing it to everyone. I realized something then. I hadn't built the models, but I could help make them easier to reach. The labs want the same thing. They're working to make inference cheaper, faster, and open to everyone. The problem is all the layers sitting on top. They slow it down, mark it up, and gate who gets in. So I made FlexInference as a crack at that. It makes getting to these providers cheaper, faster, and more reliable. The first way it does that is by hunting for cheaper inference, and escalating to standard when it can't find any. By making it cheaper to work with these models, ideally we can get more ideas out there. More incredible products. And as such, help more people. That's why I created FlexInference. Hopefully, it helps you all. Sincerely, Adi P.S. It's free for all requests. And I only really charge when I save you money, so it's profitable to use FlexInference. P.P.S I tried to make it super easy to use FlexInference. It's strictly typed. It also won't quietly fall back to parameters you never set just to force a request through. You also don't need to use the FlexInference SDK and can just change the URL and key instead. Connect your agent and let it do the rest. FlexInference runs an MCP server, so Claude, Cursor, and any other MCP client can check your usage, manage your API keys, and search the docs without leaving your editor. Point it at https://mcp.flexinference.com/mcp and you are set. The docs tools need no login. Anything that touches your account runs over OAuth and asks first, so a client reads your usage or changes a key only after you approve it. It never runs inference and never takes a raw provider key. See the MCP guide - https://docs.flexinference.com/mcp-server