{"slug": "jev-is-a-total-shift-in-how-we-use-llms-for-automation", "title": "Jev is a total shift in how we use LLMs for automation", "summary": "Former OpenAI researcher Diogo Almeida launched Jev, a \"System One\" model that outputs only probability judgments rather than generated text, and developers have built nearly 500 open-source projects around it within days of launch. Jev is priced at $0.042 per million input tokens with free output, and one developer used it to cut a 1 million token Claude Code context to 86k tokens in one second, while another processed 9,081 product matching records in 13 minutes for $0.32. The model's arrival points to a split architecture in which cheap judgment models handle millisecond-level decisions and expensive generative models are reserved for human-readable output.", "body_md": "# Jev is a total shift in how we use LLMs for automation\n\nI've been seeing a lot of noise about HA-Jev, a plugin for Home Assistant. The logic is dead simple: it monitors a washing machine's power draw and the laundry room door status. Instead of writing a paragraph, the model just outputs a probability value. If the confidence hits 0.8, you get a notification asking if you forgot your clothes. A single check takes a few milliseconds and costs $0.000015.\n\nThe dev's point is spot on—why use a massive LLM to write an essay when you just need a yes/no judgment? We've spent years optimizing for \"human-like\" fluency, but for actual system engineering, that fluff is just overhead.\n\nEnter Jev, a \"System One\" model from former OpenAI researcher Diogo Almeida. It doesn't generate text at all; it only outputs probability judgments. Within days of launch, developers have already built nearly 500 open-source projects around it. It's basically the opposite of a chatbot.\n\n## Using Jev as a high-speed filter\n\nThe real power here is treating Jev like a cheap, fast neuron rather than a philosopher. I'm seeing some wild use cases for context compression. One dev, Tamara Tran, used a Jev plugin to scrub [Claude Code](https://promptcube3.com/en/tags/claude%20code/) contexts. Instead of summarizing (which is expensive and slow), Jev scores the relevance of historical tool calls. Anything below a certain threshold gets deleted. In one case, a bloated 1 million token context was slashed to 86k tokens in one second without the model generating a single word of text.\n\n## Real-world speed and cost benchmarks\n\nThe performance gap between generative models and \"judgment\" models is staggering:\n\n- **Mobile Automation:** The Droidrun team built mobile-jev. In a demo, it navigated an Android phone to a Uber payment screen in 9 steps over 21 seconds. It didn't \"generate\" instructions; it just used Jev for rapid probability matching on where to click or swipe.\n- **Data Cleaning:** One dev had 9,081 product matching records. Using top-tier LLMs was too expensive, but with a 150-line script and Jev, the whole task finished in 13 minutes for exactly $0.32.\n- **SEO Mapping:** Distribb's founder scanned 600 pages and restructured internal links (8,790 decisions) in 45 seconds for $0.21.\n- **Gaming:** People are using it for Super Mario, Doom, and even StarCraft combat missions because it can make decisions in milliseconds.\n\n## The economics of the \"Jevons Paradox\"\n\nThe pricing is the kicker: $0.042 per million input tokens, and output is free. If you're making 10,000 business decisions a day, you're looking at about $120 a month. Doing the same with a top-tier reasoning model could easily blow out to $35,000.\n\nThis is a classic Jevons Paradox—when efficiency makes a resource cheaper, we don't use less of it; we use way more. We're moving from \"can I afford to run this check?\" to \"I can run a semantic filter on every single database row.\"\n\n## Shifting to a distributed AI architecture\n\nWe're finally seeing a split between \"judgment\" and \"generation.\" For the last few years, we treated intelligence as one big block. Jev proves that binding reasoning and expression together is a waste of resources.\n\nThe community is moving fast. vLLM contributors already used Google's DiffusionGemma to create an open-source version with accuracy close to the official one.\n\nThe future architecture isn't one giant brain. It's a system where cheap, \"intuitive\" models handle the millions of millisecond-level judgments, and the expensive generative models only wake up when you actually need a human-readable report or a complex piece of writing.\n\n[Next Vidu S2 actually lets you edit video in real-time →](https://promptcube3.com/en/threads/9498/)\n\n## All Replies （3）\n\nI want to try this tonight. I've spent hours fighting with 15 different automation triggers just to get a simple alert.\n\nCuriosity is peaking. Does this work with the 2024.1 update, or is it only for the legacy version of the plugin?\n\nThis burned me during my last setup. Does the prompt need a specific temperature setting to avoid looping the power check?", "url": "https://wpnews.pro/news/jev-is-a-total-shift-in-how-we-use-llms-for-automation", "canonical_source": "https://promptcube3.com/en/threads/9543/", "published_at": "2026-09-21 13:05:48+00:00", "updated_at": "2026-09-21 13:24:56.474719+00:00", "lang": "en", "topics": ["large-language-models", "ai-agents", "ai-tools", "ai-products", "ai-infrastructure"], "entities": ["Jev", "Diogo Almeida", "OpenAI", "Home Assistant", "HA-Jev", "Claude Code", "Tamara Tran", "vLLM"], "alternates": {"html": "https://wpnews.pro/news/jev-is-a-total-shift-in-how-we-use-llms-for-automation", "markdown": "https://wpnews.pro/news/jev-is-a-total-shift-in-how-we-use-llms-for-automation.md", "text": "https://wpnews.pro/news/jev-is-a-total-shift-in-how-we-use-llms-for-automation.txt", "jsonld": "https://wpnews.pro/news/jev-is-a-total-shift-in-how-we-use-llms-for-automation.jsonld"}}