Snapdragon X2 Elite and Kilo by Anaconda: Local AI on the NPU Anaconda's Kilo Desktop now connects to Microsoft Foundry Local to run open models on the Hexagon NPU in Snapdragon X2 Elite laptops, keeping prompts and code on the device. The Hexagon NPU in Snapdragon X2 Elite delivers 80+ TOPS, up from 45 TOPS in the Snapdragon X Elite, and Foundry Local's catalog lists 11 models built for the Qualcomm AI Engine (QNN), including Qwen2.5 Coder and DeepSeek R1 Distill builds. Foundry Local ships as a roughly 20 MB package with native SDKs in C, C++, C#, JavaScript, Python and Rust, and Kilo Desktop reaches it through a standard OpenAI-compatible API. Co-authored with Devang Aggarwal, and Srinivasa Deevi. Snapdragon X2 Elite laptops are paired with the best in-class Hexagon NPU with long battery life, and Kilo Desktop by Anaconda gives that NPU real work to do. Kilo Desktop is one app for building with AI, where you can plan, write, test, and debug code. Connect it to Microsoft Foundry Local, which serves open models on the Snapdragon NPU, and your prompts and code can stay on your machine. Anaconda’s native Windows on Snapdragon support brings Python, conda, and vetted packages to Snapdragon PCs. Kilo Desktop sets up conda environments for you inside the app, so the laptop is ready for Python work from the first prompt. Foundry Local handles the model, Kilo Desktop handles the project, and the two talk through a standard OpenAI-compatible API. An NPU built for local models The Hexagon NPU in Snapdragon X2 Elite has 80+ TOPS, up from 45 TOPS in the Snapdragon X Elite. The NPU runs model inference on its own silicon, which leaves the Oryon CPU cores free for your Python code, tests, and builds. Explore Snapdragon X2 Elite https://www.qualcomm.com/laptops/products/snapdragon-x2-elite . In Kilo Desktop, you manage a project’s environments in the same app where you work with the model, so your code, notebooks, and data stay together. Local AI on the NPU with Foundry Local Foundry Local is an end-to-end local AI solution for building applications that run entirely on the user’s device. It provides native SDKs C, C++, C , JavaScript, Python, and Rust , a curated catalog of optimized models, and automatic hardware acceleration - all in a lightweight package ~20 MB . The compact size makes it easy to integrate into your application and distribute to end users. It also has an accompanying CLI, which allows you to persist an OpenAI compatible endpoint to connect into other applications such as Kilo Desktop. Foundry Local’s model catalog https://www.foundrylocal.ai/models?npu&acceleration=qnn lists 11 models built for the Qualcomm AI Engine QNN , including Qwen2.5 Coder and DeepSeek R1 Distill builds. Install Foundry Local and the latest Qualcomm NPU driver, then pick a model. When you run a model by its alias, Foundry Local picks the best hardware it finds, preferring the NPU over the GPU and CPU. To pin the NPU build, use its full model ID: foundry run qwen2.5-coder-7b-instruct-qnn-npu:1 foundry run deepseek-r1-distill-qwen-7b-qnn-npu:2 The service port can change between sessions, so run foundry service status to get the current address. Requests to /v1/models on that address return the exact model IDs you’ll enter in Kilo Desktop. - Qwen2.5 Coder 7B Instruct 4.7 GB : writing, explaining, and fixing code - Qwen2.5 Coder 1.5B Instruct 1.3 GB : fast completions on lighter tasks - DeepSeek R1 Distill Qwen 7B 5.3 GB : step-by-step reasoning about data and bugs - DeepSeek R1 Distill Qwen 14B 9.8 GB : harder reasoning, if memory allows Connect Foundry Local to Kilo Desktop Kilo Desktop treats Foundry Local as a custom AI provider, so the NPU model shows up in the same model picker as every other model. Open the Add custom AI provider dialog and fill in four fields: 1. Provider name: something you’ll recognize, such as Foundry Local NPU. 2. API format: OpenAI Compatible. 3. Base URL: the address from foundry service status , ending in /v1 for example, http://127.0.0.1: