cd /news/artificial-intelligence/app-developers-turn-to-qvac-for-ai-t… · home › topics › artificial-intelligence › article
[ARTICLE · art-172143] src=networkworld.com ↗ pub= topic=artificial-intelligence verified=true sentiment=↑ positive

App developers turn to QVAC for AI tooling without the cloud

Tether released a QVAC software development kit in 2026 that runs AI models directly on user devices, with its Fabric component built on llama.cpp to enable on-device fine-tuning across Vulkan, Metal/Core ML and CUDA backends. In September 2026 the QVAC SDK integrated the open-source TurboVec vector index, which Tether says shrinks embedding memory usage by up to 8 times at 4-bit quantization, bringing retrieval-augmented generation to offline apps without sending user data to the cloud. The SDK also bundles quantized versions of common open-source models alongside Tether's own lightweight models, targeting hardware that cannot host frontier-scale systems requiring data-center GPUs and hundreds of gigabytes of memory.

key takeaway

Tether's QVAC SDK pairs a llama.cpp-based Fabric engine with the TurboVec vector index, which cuts embedding memory use up to 8x at 4-bit quantization so RAG can run on-device instead of in the cloud.

read4 min views3 publishedNov 18, 2026

In most instances today, adding AI to an app means sending user data to a third-party API, paying per request, and hoping the connection holds.

Tether’s QVAC is built on the opposite premise. It runs AI models directly on the user’s device. Data never leaves the hardware, there are no per-request costs, no rate limits, and no need for an internet connection once a model is downloaded.

QVAC SDK: the next milestone in cloud-free AI

While open-source tools and standards like llama.cpp, GGML, and ONNX have made local AI much more accessible in recent years, creating new possibilities for consumer devices, the edge AI ecosystem remains fragmented. Against this backdrop, in 2026, Tether released a software development kit (SDK) that pulls together the best open tooling from across different domains of machine learning.

The centerpiece of Tether’s QVAC SDK is Fabric. Built on llama.cpp, it expands the engine to enable on-device fine tuning and additional AI capabilities—opening access to memory-intensive workloads previously only possible with expensive hardware or cloud services.

Building on GGML’s modular framework, QVAC Fabric is primarily oriented toward three backends: Vulkan, which covers most consumer-grade desktop and mobile chips; Metal and Core ML for Apple Silicon; and CUDA for higher-end NVIDIA GPU setups.

The QVAC SDK empowers developers with a unified interface for building multiplatform AI apps that run on-device. But although significant progress has been made in bringing inference to consumer devices, text generation alone is only one part of the pipeline that makes modern AI useful.

Bringing search to edge AI

RAG (retrieval-augmented generation) is what equips AI to import and process contextual information to enhance its output. Instead of language models relying solely on their training data to answer questions, RAG lets them answer using a specific set of documents.

Implementing RAG into an AI app incurs significant memory overhead versus running a model alone. Alongside the core language model’s inference, RAG requires a second embedding model and a specialized database system known as a vector index.

These vector indexes can be huge, often much larger than the plain text files they represent and easily surpassing the RAM capacity of consumer hardware. As a result, most RAG operations are offloaded to the cloud, along with the user’s personal information. But vector indexing doesn’t have to mean sacrificing privacy or getting locked in to pay-per-token subscriptions.

In September 2026, the QVAC SDK integrated TurboVec. The open-source vector index shrinks embedding memory usage by up to 8 times (4-bit quantized). This lowers hardware requirements and significantly increases the speed of search and retrieval, paving the way for RAG to be integrated into offline, cloud-free apps that can access local databases without leaking personal information.

Lightweight AI models

Running AI locally only works if it fits the hardware people actually own. Frontier-scale systems typically need data-center GPUs and hundreds of gigabytes of memory. That’s why the QVAC SDK integrates quantized versions of common open-source models, while Tether has also developed its own lightweight models designed to run on a phone or personal computer, and distributed peer-to-peer via its registry.

QVAC Psy is a family of specialized low-weight models that run on the QVAC SDK. Using specially curated training data, each model is trained to perform specific tasks at the same or a higher level than much larger AI platforms. For example, despite weighing in at just 800 million parameters, the smallest variant of Tether’s translation model for African languages outperformed Google’s 27 billion parameter TranslateGemma on key benchmarks.

By pairing these compact models with other memory-saving features packed into the QVAC SDK, Tether is proving that local AI doesn’t mean compromising on performance. And once apps can deliver real-world utility without the need for massive data centers, users get to enjoy unlimited, secure intelligence for free, without an internet connection.

Why you should consider local AI

Tether’s tooling has the potential to transform how AI is built and used, with benefits for developers and end users alike.

Without the burden of recurring API costs or expensive cloud hosting, independent creators and smaller studios can implement AI features that previously required enterprise-scale budgets. Meanwhile, processing sensitive information directly on local hardware addresses privacy concerns and can help to ease compliance with regulations like GDPR and HIPAA, opening the door for secure AI apps in the healthcare, legal and financial sectors.

If you’re ready to eliminate ongoing API fees and take full control of your application’s data, download the QVAC SDK and join the growing community of builders rejecting the cloud.

── more in #artificial-intelligence 4 stories · sorted by recency
── more on @tether 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/app-developers-turn-…] indexed:0 read:4min 2026-11-18 · —