cd /news/ai-tools/i-asked-an-llm-which-listings-to-ski… · home › topics › ai-tools › article
[ARTICLE · art-146996] src=dev.to ↗ pub= topic=ai-tools verified=true sentiment=· neutral

I asked an LLM which listings to skip. It kept getting the numbers wrong.

A developer built Kriterio, a Chrome extension that checks web listings against user-defined rules and flags them green, amber or red with a stated reason. After finding that an LLM misread prices and invented return policies while sounding equally confident when wrong, the developer split the work so numeric checks like budget parsing run in plain code and the model only handles soft rules. The extension is free to try and the developer is asking how others decide whether to let a model handle numeric judgments.

read1 min views2 publishedOct 7, 2026

I waste a stupid amount of time reading pages just to find the one line that rules them out.

A job post where the budget is hidden at the very bottom. "Brand new" headphones where the seller note, three scrolls down, says refurbished. A

So I thought, easy, I'll paste the page into an LLM with my own rules and ask "should I bother with this?"

Something like:

My rules: budget at least $500, max 3 revisions.
Here's the job post: ...
Should I apply? Answer yes or no and why.

It worked most of the time. Then it said yes to a $300 job. It took "List price: $79" as the price when the real price was $129. It told me a product had a 30-day return window on a page that never mentioned returns.

The problem wasn't that it was wrong sometimes. It was that it sounded exactly as sure when it was wrong.

What fixed it was splitting the work:

Roughly:

const budget = readMoney(page, ['budget']); // plain parsing, not the LLM
if (budget !== null && budget < rules.minBudget) {
  return no(`Budget is $${budget}, under your $${rules.minBudget} minimum.`);
}
// only now ask the model about the soft rules

I wrapped it in a Chrome extension called Kriterio. You set your limits once, open a page, and it shows green, amber or red with the reason. I mostly use it for [job posts / shopping / whatever you actually use it for].

It's free to try if you want to poke holes in it and give me feedback: https://chromewebstore.google.com/detail/phmlfimaombpolnlcmgohocekndiinpf

Curious how others handle this. Do you let the model decide anything numeric, or do you always check it in code?

── more in #ai-tools 4 stories · sorted by recency
── more on @kriterio 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/i-asked-an-llm-which…] indexed:0 read:1min 2026-10-07 · —