{"slug": "no-signal-no-problem-smaller-models-bring-more-ai-capabilities-on-device", "title": "No signal, no problem: Smaller models bring more AI capabilities on-device", "summary": "Tether's QVAC research team released Genesis III, a synthetic training dataset of 191 billion tokens spanning 19 STEM domains, as part of its push toward compact on-device AI models. Tether's suite of small models, the largest at around four billion parameters, includes MedPsy for medical reasoning, TranslatePsy for translation and VisionPsy for visual processing, and the company says these lightweight specialized models can outperform larger generalist ones on specific tasks while running on off-the-shelf consumer hardware, some on a basic smartphone without an internet connection. The release reflects a countercurrent to frontier scaling, which Tether argues faces diminishing returns and a depleted supply of human-generated training data.", "body_md": "When OpenAI’s GPT-3 was released in 2020, at 175 billion parameters, it was the largest language model the world had ever seen. In the years that followed, frontier AI systems exploded in size, with today’s largest models clocking in at well over a trillion parameters. But there is a countercurrent of AI research moving in the opposite direction, with pioneers like Tether building a new generation of [smaller AI models](https://qvac.tether.io/products/models).\n\nRequiring a fraction of the computing power of their heavyweight cousins, this emerging field of lightweight models is driving a shift toward more on-device AI, with a growing range of applications now able to run locally, rather than relying on the cloud.\n\nAt around four billion parameters, even the largest among Tether’s suite of compact models is tiny compared to frontier AI systems, while others are small enough to run on a basic smartphone, without requiring an internet connection once downloaded.\n\nAs AI labs have pursued larger context windows, more sophisticated reasoning, and multimodal capabilities, model sizes have increased significantly in recent years, to the extent that parameter count, cluster size, and megawatt consumption are often framed as proxies for performance.\n\nThis narrative assumes that bigger is always better, and for a while, it was. Research has demonstrated the existence of scaling laws: predictable mathematical relationships showing that increasing model parameters, training data, and compute power led directly to superior performance and emergent capabilities. To build more intelligent systems, frontier AI developers simply had to throw more resources at the challenge.\n\nThe problem is that brute force AI scaling offers diminishing returns. And while global data center capacity is expanding rapidly, the supply of human-generated training data that fueled language model growth until now is [increasingly depleted](https://arxiv.org/pdf/2211.04325).\n\nMoreover, reducing cross-entropy loss (what scaling laws actually measure) was never a direct stand-in for advances in AI capability. In reality, the greatest leaps in performance have usually come from better training data, new techniques and innovative designs. And in an age of runaway AI investment, gigawatt-scale data centers and multi-billion dollar cloud budgets, researchers are [growing skeptical](https://papers.ssrn.com/sol3/papers.cfm?abstract_id=5877662) of the notion that scale will remain such a key lever for progress.\n\nWhile a small number of powerhouse AI labs remain locked in a battle for frontier dominance, some of the most exciting developments are happening elsewhere.\n\nFor instance, Tether’s compact models span various domains, including medical reasoning ([MedPsy](https://qvac.tether.io/blog/meet-medpsy-a-private-medical-ai-small-enough-for-your-phone)), translation ([TranslatePsy](https://tether.io/news/tether-releases-open-source-ai-translation-models-for-african-and-european-languages/)), and visual processing ([VisionPsy](https://tether.io/news/tether-data-open-sources-visionpsy-nano-best-in-class-460m-on-device-vision-language-model-leading-industry-benchmarks/)).\n\nIn each case, the company has proven that lightweight, specialized models can routinely outperform larger generalist ones on specific tasks, all while running smoothly on off-the-shelf consumer hardware.\n\nTo fit more intelligence into a smaller container, Tether’s QVAC research team has focused on data curation and compression techniques like quantization.\n\nMost recently, the team [released Genesis III](https://qvac.tether.io/blog/genesis-iii-stem-training-data), expanding the corpus of synthetic training data from previous generations to include 191 billion tokens spanning 19 STEM domains. In contrast to the giant libraries of web-scraped data used to train the first wave of LLMs, Genesis datasets are highly specialized. Think of them as educational textbooks, complete with correct and incorrect examples, and reasoning steps to help AI models develop expertise in a specific area.\n\nAs well as curating high-quality training data, Tether uses a compression technique known as quantization to make its models run more efficiently. Unlike distillation, which reduces the number of parameters in a model, quantization swaps high-precision weights for leaner, low-bit ones that take up less memory.\n\nWithin the open-source AI movement, 8-bit and 4-bit models have become the default for many projects. At the cutting edge of on-device AI development, even single-bit models can now deliver impressive results.\n\nBringing AI to consumer devices isn’t just about shrinking the underlying models. QVAC also provides a modular toolkit to help developers build full applications, with each component optimized for the kind of hardware found in smartphones and personal computers.\n\nFor example, the [QVAC SDK](https://qvac.tether.io/products/sdk) integrates TurboQuant, an open-source memory compression tool that reduces the size of AI models’ Key-Value (KV) cache by up to 80 percent.\n\nBeyond reducing inference needs, the [latest addition](https://qvac.tether.io/blog/turbovec-local-vector-search) to the software development kit, TurboVec, targets data retrieval, another area where memory and compute capacity define the limits of on-device applications.\n\nWhen AI workloads exceed the limits of a single device, the same SDK update introduced clustered inference, letting developers pool the resources of [multiple machines](https://x.com/qvac/status/2107395538736042438). Thanks to these advances, powerful capabilities that were once the preserve of cloud-hosted AI can now run seamlessly at your desk or in your pocket. \n\nAt a time of diminishing returns from brute-force scaling and mounting frustration with the status quo, there has never been a better time to discover what’s possible with [Tether’s small models](https://qvac.tether.io/products/models).", "url": "https://wpnews.pro/news/no-signal-no-problem-smaller-models-bring-more-ai-capabilities-on-device", "canonical_source": "https://www.computerworld.com/article/4239203/no-signal-no-problem-smaller-models-bring-more-ai-capabilities-on-device.html", "published_at": "2026-10-27 10:34:46+00:00", "updated_at": "2026-10-27 10:44:37.900455+00:00", "lang": "en", "topics": ["artificial-intelligence", "machine-learning", "large-language-models", "ai-research", "ai-products"], "entities": ["Tether", "QVAC", "Genesis III", "MedPsy", "TranslatePsy", "VisionPsy", "OpenAI", "GPT-3"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/no-signal-no-problem-smaller-models-bring-more-ai-capabilities-on-device", "markdown": "https://wpnews.pro/news/no-signal-no-problem-smaller-models-bring-more-ai-capabilities-on-device.md", "text": "https://wpnews.pro/news/no-signal-no-problem-smaller-models-bring-more-ai-capabilities-on-device.txt", "jsonld": "https://wpnews.pro/news/no-signal-no-problem-smaller-models-bring-more-ai-capabilities-on-device.jsonld"}}