{"slug": "ollama-0-34-local-models-inside-chatgpt-desktop", "title": "Ollama 0.34: Local Models Inside ChatGPT Desktop", "summary": "Ollama released version 0.34 on September 5, adding macOS integration that lets ChatGPT Desktop run local Ollama models such as Gemma 4 and Llama, plus a new cloud tier for large open-weight models. The local integration redirects ChatGPT Desktop requests to 127.0.0.1:11434 and supports up to five local models, while cloud models with a :cloud suffix run on Ollama's servers, with a free tier limited to sessions resetting every five hours, Pro at $20/month for 50× the free quota, and Max at $100/month closed to new signups. Ollama also added image and audio input for gemma4:12b-mlx and gemma4:31b-mlx on Apple Silicon and faster structured output via Metal kernels.", "body_md": "Ollama 0.34 landed on September 5 and it does two things that will make developers do a double take. First: your local Ollama models now run inside ChatGPT Desktop on macOS, so the app you already have open is no longer locked to GPT-4o. Second: Ollama now offers cloud models — large open-weight models that run on Ollama’s own servers, pulled with the same `ollama run` command you already know. A tool synonymous with local AI is quietly becoming something bigger.\n\n## ChatGPT Desktop Now Runs Your Local Models\n\nThis is the headline feature and the most counterintuitive thing in this release. [Ollama v0.34.0](https://github.com/ollama/ollama/releases/tag/v0.34.0) integrates directly with ChatGPT Desktop on macOS — the app millions of developers already use for Projects, file uploads, and MCPs. Swap the underlying model to Gemma 4 or Llama running on your own hardware and zero prompts leave your machine to OpenAI’s servers.\n\nSetup is macOS-only in v0.34 (Windows and Linux support is expected but not yet shipped). The steps are short:\n\n```\n# Step 1: Update Ollama\nbrew upgrade ollama\n\n# Step 2: Pull a model\nollama pull gemma4:12b-mlx\n\n# Step 3: Ollama menu bar app → Integrations → ChatGPT Desktop → Enable\n```\n\nOllama rewrites ChatGPT’s local configuration to redirect requests to `127.0.0.1:11434`. Once enabled, the model switcher in ChatGPT Desktop lists your Ollama models alongside GPT-4o. You can expose up to five local models. Projects, conversation history, and file attachments continue working normally. What doesn’t transfer: DALL-E image generation, voice mode, and O1 reasoning — those depend on OpenAI’s infrastructure and remain unchanged.\n\nThe privacy implication is worth noting for teams. Conversations routed to a local Ollama model never touch OpenAI’s servers. If your organization has data handling concerns about cloud AI, this path runs entirely on your hardware through ChatGPT’s interface. Check [Ollama’s ChatGPT Desktop docs](https://docs.ollama.com/integrations/chatgpt) for the full setup walkthrough.\n\n## Cloud Models: Ollama Extends Its Reach\n\nAlongside the local model integration, Ollama now offers a cloud tier. Models with a `:cloud` suffix run on Ollama’s own datacenter hardware rather than your GPU — same CLI syntax, different compute location.\n\n```\n# Sign in to Ollama first\nollama signin\n\n# Run a trillion-parameter model you can't run locally\nollama run kimi-k2.6:cloud\n\n# Browse available cloud models\nollama search --filter cloud\n```\n\nCurrent options include `kimi-k2.6:cloud` (Moonshot’s 1T-parameter model), `deepseek-v4-pro:cloud`, `qwen3-coder-480b:cloud`, and several others — see the full list at [ollama.com/search](https://ollama.com/search?c=cloud&o=newest). Pricing is billed by GPU time rather than tokens. Free tier has session limits that reset every five hours. Pro runs $20/month for 50× the free quota. Max is $100/month and currently closed to new signups.\n\nThe privacy caveat is direct: cloud model prompts leave your machine and route through Ollama’s servers. If you need local inference, use a local model. If you need a 480B coding model and don’t have a rack of H200s, `qwen3-coder-480b:cloud` is there.\n\n## Gemma 4 on MLX Gets Images and Audio\n\nApple Silicon users get a notable addition: `gemma4:12b-mlx` and `gemma4:31b-mlx` now accept image and audio inputs through the MLX engine. Long audio clips are automatically chunked — no manual splitting needed. Unsupported model checkpoints fall back to text-only gracefully rather than crashing. For multimodal pipelines on Mac, this is a real capability gain. Put image or audio content before text in your prompt; that’s the recommended input order per the release notes. Background on the MLX performance story is on the [Ollama MLX blog](https://ollama.com/blog/mlx-performance).\n\n## Two Smaller Fixes Worth Knowing\n\nStructured output — JSON mode, grammar-constrained decoding — is now faster on Apple Silicon. Ollama now uses Metal kernels for tokenization during constrained decoding on M-series chips. Tool-calling heavy workloads get a meaningful speedup. Separately, 0.34 now honors the default parameters embedded in GGUF files: temperature, context length, and others. Community GGUF models now behave the way their creators intended without requiring a custom Modelfile override. This one has been requested for years.\n\n## What This Release Means\n\nOllama was the tool you used to avoid being locked into a cloud AI vendor. With 0.34, it’s becoming the inference layer that works across local and cloud open-weight models and now bridges into OpenAI’s own desktop client. That’s not a contradiction — it’s a product strategy. Ollama raised $88M this summer and cloud inference is how that investment gets a return. The ChatGPT Desktop integration is also user acquisition: if developers can run Gemma inside ChatGPT without changing their workflow, they’ll install Ollama to do it.\n\nThe practical result is useful regardless of how you feel about the strategy. Update to 0.34 if you’re on macOS and use ChatGPT Desktop, run the Integrations setup once, and your local models are available immediately. Cloud models are worth testing for large-parameter tasks you can’t run locally — the free tier is enough to evaluate quality before committing to Pro.", "url": "https://wpnews.pro/news/ollama-0-34-local-models-inside-chatgpt-desktop", "canonical_source": "https://byteiota.com/ollama-0-34-local-models-inside-chatgpt-desktop/", "published_at": "2026-09-16 07:11:22+00:00", "updated_at": "2026-09-16 08:12:35.683907+00:00", "lang": "en", "topics": ["ai-tools", "large-language-models", "ai-infrastructure", "ai-products", "developer-tools"], "entities": ["Ollama", "ChatGPT Desktop", "OpenAI", "Gemma 4", "Llama", "kimi-k2.6:cloud", "qwen3-coder-480b:cloud", "Moonshot"], "alternates": {"html": "https://wpnews.pro/news/ollama-0-34-local-models-inside-chatgpt-desktop", "markdown": "https://wpnews.pro/news/ollama-0-34-local-models-inside-chatgpt-desktop.md", "text": "https://wpnews.pro/news/ollama-0-34-local-models-inside-chatgpt-desktop.txt", "jsonld": "https://wpnews.pro/news/ollama-0-34-local-models-inside-chatgpt-desktop.jsonld"}}