rightmodeler replays your real agent traces through cheaper models, judges each output against what you already shipped, and shows exactly where you can cut cost — with evidence and confidence on every call.
0%
Approvedpr_summary
gpt-4.1 → gpt-4o-mini Pending — cascade risktool_agent
claude-opus-4 → llama-3.3-70b Approvedjson_extraction
gpt-4o → gpt-4o-mini Approvedsql_generation
gpt-4o → deepseek-chat Abstainedauth_code_edit
gpt-4.1 → —
Approved1pr_summarygpt-4.1 → gpt-4o-mini72%0.94reference+judge—
Pending — cascade risk2tool_agentclaude-opus-4 → llama-3.3-70b41%0.88trajectory Approved3json_extractiongpt-4o → gpt-4o-mini68%1.00deterministic—
Approved4sql_generationgpt-4o → deepseek-chat55%0.91reference—
Abstained5auth_code_editgpt-4.1 → ———none
Reads the traces you already have.
Reads traces from Claude Code, Codex, LangSmith / LangGraph, OpenAI SDK, Langfuse, Braintrust, Phoenix (OpenInference), OTel GenAI.
Run it on your own traces. #
It’s a report, not a runtime gateway — prove the savings on your own data first.