Want to run an AI model locally, but still use it with the tools you already have? Atomic Chat makes that possible. It lets you run open-weight LLMs from Hugging Face on your own computer, then exposes them through an OpenAI-compatible API so coding agents, CLIs, IDE plugins and other apps can use your local models too. You can run models such as Llama, Gemma, Qwen, Mistral and Phi, use Atomic Chat as a regular AI chat app, or connect it to tools such as OpenCode, Goose and Kilo Code. Your local conversations and API keys can stay on your machine, while cloud providers such as OpenAI, Anthropic, Mistral and Groq are available when you need them. Under the hood, it also supports multiple inference engines and performance features such as speculative decoding, Flash Attention and TurboQuant on supported models and hardware. So you're getting more than a local chatbot. Atomic Chat can act as the local AI layer behind the rest of your setup.
Comparing Local Tool Calling: Gemma 4 vs. Llama 3 vs. Mistral