cd /news/ai-agents/show-hn-distill-and-serve-small-mode… · home topics ai-agents article
[ARTICLE · art-74718] src=github.com ↗ pub= topic=ai-agents verified=true sentiment=↑ positive

Show HN: Distill and serve small models with frontier quality for half the cost

Experiential Labs launched wmo serve, an open-source tool that routes repetitive agent tasks to distilled smaller models, achieving frontier quality at 40%+ lower cost. The tool uses an OpenAI-compatible endpoint and continuously improves models through distillation from open-source models and token compaction.

read1 min views1 publishedJul 26, 2026

Hi HN, we built world-model-optimizer, an open-source tool for continually improve models specialized to agents. Today we are launching wmo serve, a tool to route repetitive tasks to distilled smaller models.

Agent traces you already capture are opportunities to get signal on how to make your model cheaper, faster, better. We continuously improve - your specialized model through distillation from open source models - model routing to frontier + custom models - token compaction to remove noise and save tokens

Demo: https://www.youtube.com/watch?v=2_m4Ze6mdko Pass in traces and an OpenRouter key, and wmo starts a local OpenAI-compatible endpoint to run with your model at a lower cost with equivalent quality. Behind the scenes a router decides which tasks should go to the frontier versus your model. Tinker continually trains as new traces arrive.

We also offer a hosted solution for anyone that just wants a frontier quality endpoint with self-improvement over time at a 40%+ lower cost.

Sign up for the waitlist at [https://experientiallabs.ai](https://experientiallabs.ai) and give the repo a star!

Comments URL: [https://news.ycombinator.com/item?id=49063454](https://news.ycombinator.com/item?id=49063454)

Points: 3

── more in #ai-agents 4 stories · sorted by recency
── more on @experiential labs 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/show-hn-distill-and-…] indexed:0 read:1min 2026-07-26 ·