Introducing Unsloth Desktop
Unsloth Desktop (Beta) is a free, open-source app for running and training AI models on your own local hardware. Available for macOS, Windows, and Linux.
Unsloth lets you run, train and deploy LLMs, diffusion image/video, MLX, GGUF and audio models.
Download Unsloth DesktopFeaturesGitHub Features ✨
Get started 🦥
Install Unsloth Desktop, download a model, and start chatting in minutes.
Download Unsloth Desktop:macOSWindowsLinux and WSL
Install Unsloth Desktop
Download
Unsloth DesktopLaunch the app
Unsloth is now ready
To chat, type a message and press Enter.
Connect tools:Claude Code,Codex,web search,MCPand moreTrain models: Fine-tune text, diffusion,embedding, and more
Feature Deep Dive ⭐
See everything Unsloth Desktop has to offer:
Access model anywhere #
Serve your local or Colab models over HTTPS through Unsloth's free Cloudflare tunnel. Check a run from your phone, your laptop, or anywhere else you happen to be.
Bind the app to your network with -H 0.0.0.0
, or open a free Cloudflare tunnel for HTTPS:
Use Cloud Models #
Run models from OpenAI, Anthropic, Ollama, llama.cpp, vLLM, and more.
Use the same Unsloth chat interface for local and cloud models with support for tool-calling, image gen, prompt caching to reduce token usage while preserving provider-native features like OpenAI’s web search and code execution.
Connect your Agent #
Unsloth Start lets you connect Claude Code, Codex and other agents to local models via the unsloth start
command.
Start Unsloth, load a model, open your project folder, and then run:
Do you collect my data?
No telemetry. Unsloth detects your GPU type and device so the app can know what works. The app can run entirely offline.
Can I use models I already downloaded?
Yes, they are found automatically. If yours are not you can specify your own custom folders.
Why is inference slower sometimes?
Web search, code execution and tool-call healing all cost time. Turn them off and speed should match any other llama.cpp app. Still slow? Open a GitHub issue.
GPU only?
No. Unsloth works on a wide variety of CPU, Mac etc setups.
Does it support OpenAI-compatible APIs?
Yes. See the API guide. We also support connection to Cloud models or other APIs like Anthropic or OpenAI.
What devices does Unsloth support?
Unsloth supports all OS including Mac, Windows, Linux and WSL and supports NVIDIA, Intel, AMD and Mac GPUs/CPUs. Older hardware however may not be well supported.
A huge thank you to NVIDIA and Hugging Face for being part of our launch. Also thanks to all of our early beta testers for Unsloth Desktop, we truly appreciate your time and feedback. We’d also like to thank llama.cpp, PyTorch, stablediffusion.cpp, and open model labs for providing the infrastructure that made Unsloth Desktop possible.