Perplexity announces hybrid AI system that decides what runs locally or in the cloud

Perplexity announced a hybrid AI system that automatically decides whether to process tasks locally on a user's device or route them to cloud models, optimizing for accuracy, privacy, and energy efficiency. The model-agnostic framework, developed with Intel, will be integrated into Perplexity's Always-on agent product starting in July, keeping sensitive data like financial documents local while sending compute-intensive tasks to the cloud. The company stated the system could reduce centralized computing needs and simplify data sovereignty issues, aligning its business model with efficiency incentives.

Perplexity announces hybrid AI system that decides what runs locally or in the cloud Perplexity has announced an orchestrator that combines AI models running on your own computer with powerful cloud models and automatically decides which task gets processed where. The goal is to optimize accuracy, privacy, and energy efficiency at the same time. The hybrid inference system will be integrated into the Always-on agent product Personal Computer https://the-decoder.com/perplexitys-personal-computer-promises-a-tireless-ai-agent-for-200-a-month/ , which was introduced in March, starting in July. Sensitive data like financial documents or health information will stay local, while compute-intensive tasks get routed to cloud models. Perplexity introduced the system together with Intel. But the model-agnostic framework also runs on other hardware, like Nvidia's RTX Spark https://the-decoder.de/nvidia-greift-apple-und-qualcomm-mit-eigenem-arm-chip-fuer-windows-laptops-an/ . "The race for local compute is on," the announcement says. According to Perplexity, shifting routine tasks to local devices could reduce the need for centralized computing infrastructure and simplify questions of data sovereignty. The company says its business model rewards correct answers instead of high compute consumption—which makes optimizing for efficiency a natural incentive. AI News Without the Hype – Curated by Humans Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section. Subscribe now Perplexity https://www.perplexity.ai/de/hub/blog/the-data-center-moves-to-your-machine