Unsloth Desktop

Unsloth released Unsloth Desktop (Beta), a free, open-source app for running and training AI models locally on macOS, Windows, and Linux, supporting LLMs, diffusion image/video, MLX, GGUF, and audio models. The app includes features like secure remote access via Cloudflare tunnel, integration with cloud models from OpenAI and Anthropic, and connection to agents like Claude Code and Codex, with no telemetry and offline capability.

Introducing Unsloth Desktop Unsloth Desktop Beta is a free, open-source app for running and training AI models on your own local hardware. Available for macOS, Windows, and Linux. Unsloth lets you run, train and deploy LLMs, diffusion image/video, MLX , GGUF and audio models. Download Unsloth Desktop https://unsloth.ai/download Features /docs/desktop features GitHub https://github.com/unslothai/unsloth Features ✨ Get started 🦥 Install Unsloth Desktop, download a model, and start chatting in minutes. Download Unsloth Desktop: macOS https://unsloth.ai/download/mac Windows https://unsloth.ai/download/windows Linux and WSL https://unsloth.ai/download/linux Install Unsloth Desktop Download Unsloth Desktop https://unsloth.ai/download Launch the app Unsloth is now ready To chat, type a message and press Enter. Connect tools: Claude Code /docs/basics/claude-code , Codex /docs/basics/codex , web search /docs/new/studio/chat advanced-web-search , MCP /docs/basics/mcp and more Train models: Fine-tune text, diffusion, embedding /docs/basics/embedding-finetuning , and more Feature Deep Dive ⭐ See everything Unsloth Desktop has to offer: Access model anywhere Serve your local or Colab models over HTTPS through Unsloth's free Cloudflare tunnel /docs/basics/how-to-serve-local-llms-anywhere-secure-remote-access-with-cloudflare-and-unsloth . Check a run from your phone , your laptop, or anywhere else you happen to be. Bind the app to your network with -H 0.0.0.0 , or open a free Cloudflare tunnel for HTTPS: Use Cloud Models Run models from OpenAI, Anthropic, Ollama, llama.cpp, vLLM, and more. Use the same Unsloth chat interface for local and cloud models with support for tool-calling, image gen, prompt caching https://sites.gitbook.com/preview/site mXXTe/~/revisions/KsWgqmEjr66G4kYiZdG8 prompt-caching to reduce token usage while preserving provider-native features like OpenAI’s web search https://sites.gitbook.com/preview/site mXXTe/~/revisions/KsWgqmEjr66G4kYiZdG8 web-search-and-thinking and code execution https://sites.gitbook.com/preview/site mXXTe/~/revisions/KsWgqmEjr66G4kYiZdG8 code-execution . Connect your Agent Unsloth Start /docs/integrations/unsloth-start lets you connect Claude Code /docs/basics/claude-code , Codex /docs/basics/codex and other agents to local models via the unsloth start command. Start Unsloth, load a model, open your project folder, and then run: Do you collect my data? No telemetry. Unsloth detects your GPU type and device so the app can know what works. The app can run entirely offline. Can I use models I already downloaded? Yes, they are found automatically. If yours are not you can specify your own custom folders. Why is inference slower sometimes? Web search, code execution and tool-call healing all cost time. Turn them off and speed should match any other llama.cpp app. Still slow? Open a GitHub issue. GPU only? No. Unsloth works on a wide variety of CPU, Mac etc setups. Does it support OpenAI-compatible APIs? Yes. See the API guide /docs/basics/api . We also support connection to Cloud models /docs/integrations/connections or other APIs like Anthropic or OpenAI. What devices does Unsloth support? Unsloth supports all OS including Mac, Windows, Linux and WSL and supports NVIDIA, Intel, AMD and Mac GPUs/CPUs. Older hardware however may not be well supported. A huge thank you to NVIDIA and Hugging Face for being part of our launch. Also thanks to all of our early beta testers for Unsloth Desktop, we truly appreciate your time and feedback. We’d also like to thank llama.cpp, PyTorch, stablediffusion.cpp, and open model labs for providing the infrastructure that made Unsloth Desktop possible.