EvalShift's migration report recorded a PASS verdict for a customer-support agent moved from gemini-3.7-pro to gemini-3.7-flash, with the candidate 71.2% cheaper and 61.9% faster while staying inside …
Switching the model behind an AI feature is a behavior change with no diff to review, and the worst regressions are invisible in the output, such as an agent that stops issuing a refund but still says…
A new open-source tool, Evalshift, provides a repeatable method for testing large language model (LLM) migrations by freezing a golden suite of recorded agent runs, running both source and target mode…
EvalShift's GitHub Action gates pull requests on LLM eval diffs, failing CI when regressions exceed a configured threshold. The action runs a golden JSONL suite, pushes results to EvalShift Cloud, and…