cd /news/ai-agents/startup-spotlight-confident-ai-turns… · home › topics › ai-agents › article
[ARTICLE · art-158185] src=runtimewire.com ↗ pub= topic=ai-agents verified=true sentiment=· neutral

Startup Spotlight: Confident AI turns production agent failures into tests for the next release

Confident AI, led by co-founder and CEO Jeffrey Ip, is building a hosted platform that converts failed production AI agent traces into new tests for the next release, connecting to the open-source evaluation framework DeepEval that Ip built earlier. Customer Finom reports that the platform let its product managers run evaluations directly, reducing waits for engineering, though Finom's case study does not measure AI quality. The company, listed on Y Combinator, is trying to turn open-source evaluation adoption into an enterprise workflow business.

read1 min views2 publishedOct 26, 2026
Startup Spotlight: Confident AI turns production agent failures into tests for the next release
Image: Runtimewire (auto-discovered)

Jeffrey Ip built DeepEval before Confident AI's hosted platform; Finom reports faster iteration, but its case study does not measure AI quality.

        By [RuntimeWire Staff](https://runtimewire.com/author/runtimewire-staff)
        · Published 

Primary source: [Y Combinator](https://www.ycombinator.com/companies/confident-ai)

Why it matters #

Confident AI is trying to turn open-source evaluation adoption into an enterprise workflow business. Finom says the platform let product managers run evaluations directly, reducing waits for engineering.

Confident AI targets the work triggered when an AI agent fails in production: finding the cause and preventing the next release from repeating it. Co-founder and CEO Jeffrey Ip (@jeffr_yyy) made that loop the product, connecting its open-source evaluation framework to a hosted system that can turn troublesome production traces into new tests.…

When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.

── more in #ai-agents 4 stories · sorted by recency
── more on @confident ai 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/startup-spotlight-co…] indexed:0 read:1min 2026-10-26 · —