{"slug": "thx-01-an-open-source-decision-model-that-runs-on-your-phone-and-beats-jev", "title": "THX-01: An Open-Source Decision Model That Runs on Your Phone and Beats Jev", "summary": "HAL-X AI released THX-01, a 322M-parameter open-source non-autoregressive decision model that answers typed questions over documents in a single forward pass, with roughly 10 ms GPU inference and support for 20 languages. On the company's internal four-language support-ticket classification benchmark, THX-01 reached 98.4% accuracy versus 98.5% for Claude Sonnet 5.5, with about 150× faster inference in its tests, and its calibrated confidence let a selective automation setup handle roughly 75% of tickets without errors. The model weights and inference tooling are available under the Apache 2.0 license via a pip install and Hugging Face.", "body_md": "Today, we’re releasing **THX-01**, a new open-source decision model developed by HAL-X AI.\n\nMost production AI tasks don’t actually require generating text. They require making decisions: classifying support tickets, detecting phishing emails, routing requests, extracting invoice totals, or finding evidence in documents.\n\nYet we often use large language models for these relatively simple operations. They’re powerful, but expensive, slower than necessary, and their reported confidence isn’t always meaningful.\n\n**We built THX-01 to change that.**\n\n## A Different Approach to AI\n\nTHX-01 is a **322M-parameter, non-autoregressive decision model** designed to answer structured questions directly, without generating tokens one by one.\n\nIt processes a document or message alongside typed questions and produces answers in a single forward pass.\n\nThe result is approximately **10 ms inference on GPU**, with a compact architecture small enough to run locally, even on a smartphone.\n\nTHX-01 supports **20 languages**, making it suitable for multilingual workflows and applications.\n\n## Going Beyond Jev\n\nTHX-01 follows a similar decision-oriented philosophy to Jev, but extends its capabilities.\n\nIn our benchmarks, THX-01 outperforms Jev on several tasks while introducing capabilities that Jev doesn’t support natively.\n\nThese include:\n\n- **Native number extraction:** Extracts exact numerical values from documents, including normalized formats.\n- **Verbatim excerpts:** Returns text directly from the source document rather than generating potentially fabricated quotations.\n- **Evidence citations:** Identifies supporting passages for decisions.\n- **Calibrated probabilities:** Provides confidence estimates designed to support reliable automation.\n\nTHX-01 also supports TypeSafe-style `choice`, `noul`, and `score` questions, allowing integration with existing decision pipelines.\n\n## How Does It Compare to Large Language Models?\n\nOn our internal four-language support-ticket classification benchmark, THX-01 achieved **98.4% accuracy**, compared with **98.5% for Claude Sonnet 5.5**.\n\n<escape>That’s a 0.1 percentage-point difference, with approximately 150× faster inference in our tests.</escape>\n\nBecause THX-01 produces calibrated confidence estimates, our selective automation evaluation also showed that it could process approximately **75% of tickets automatically without errors on the evaluated subset**.\n\nThese are task-specific internal results, not claims of general equivalence to a large language model. THX-01 is optimized for structured decisions rather than open-ended generation.\n\n## Built for Local AI\n\nOne of our goals was to make useful AI decision-making accessible without massive infrastructure.\n\nWith just 322 million parameters, THX-01 can run on consumer hardware, including phones.\n\nThis makes it interesting for on-device classification, document processing, agent routing, and privacy-sensitive applications where sending every request to a large hosted model is unnecessary.\n\n## Fully Open Source\n\nWe’re releasing THX-01 under the **Apache 2.0 license**, including its model weights and inference tooling.\n\nYou can install the Python package with a single command:\n\n```\npip install thx01\n```\n\nRun the model locally without an API key.\n\n**Model and weights:** [https://huggingface.co/doofz/THX-01](https://huggingface.co/doofz/THX-01)\n\n## What’s Next?\n\nWe believe the future of AI infrastructure won’t be built entirely around increasingly large generative models.\n\nIt will also require small, specialized models that make reliable decisions quickly, efficiently, and with measurable uncertainty.\n\n**Not every AI task needs a generated answer. Sometimes, it just needs the right decision.**\n\nTHX-01 is our contribution to that direction.\n\nWe’re excited to see what the open-source community builds with it.", "url": "https://wpnews.pro/news/thx-01-an-open-source-decision-model-that-runs-on-your-phone-and-beats-jev", "canonical_source": "https://doofz.substack.com/p/introducing-thx-01-an-open-source", "published_at": "2026-10-09 17:40:31+00:00", "updated_at": "2026-10-09 17:54:48.099405+00:00", "lang": "en", "topics": ["artificial-intelligence", "machine-learning", "ai-tools", "ai-products", "natural-language-processing"], "entities": ["HAL-X AI", "THX-01", "Jev", "Claude Sonnet 5.5", "Hugging Face", "Apache 2.0"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/thx-01-an-open-source-decision-model-that-runs-on-your-phone-and-beats-jev", "markdown": "https://wpnews.pro/news/thx-01-an-open-source-decision-model-that-runs-on-your-phone-and-beats-jev.md", "text": "https://wpnews.pro/news/thx-01-an-open-source-decision-model-that-runs-on-your-phone-and-beats-jev.txt", "jsonld": "https://wpnews.pro/news/thx-01-an-open-source-decision-model-that-runs-on-your-phone-and-beats-jev.jsonld"}}