{"slug": "mlx-serve-shipped-an-update", "title": "mlx-serve shipped an update", "summary": "Mlx-serve, an open-source native LLM inference server for Apple Silicon written in Zig, shipped an update that adds compatibility with the Ollama API alongside existing OpenAI and Anthropic API support, enabling tools like Raycast, Obsidian, and Open WebUI to connect without changes. The server runs MLX-format and GGUF models faster than LM Studio on the same hardware, and ships with MLX Core, a macOS menu-bar app featuring chat, agent mode, and MCP tool calling. The project has 337 stars on GitHub and was last updated in July 2026.", "body_md": "# mlx-serve\n\nNative LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent mode, and tool calling.\n\n## About mlx-serve\n\nOpenAI- and Anthropic-compatible local inference for Apple Silicon — MLX and GGUF — faster than LM Studio on the same file. No Python. No cloud. No Electron.\n\nmlx-serve is a native Zig server that runs any LLM on Apple Silicon — MLX-format models and every GGUF on HuggingFace (Qwen, Llama, Mistral, Gemma, DeepSeek V4 Flash, thousands more). It exposes OpenAI-compatible and Anthropic-compatible HTTP APIs out of the box, so the same http://localhost:11234 works with Claude Code, the OpenAI SDK, Continue, Cursor, Open WebUI, and anything else that speaks one of those wires. Ships with MLX Core, a macOS menu-bar app with chat, agent mode, MCP tool call…\n\nShort names, org/repo HuggingFace ids, and name:tag all work. And because mlx-serve speaks the Ollama API (/api/chat, /api/generate, /api/tags, /api/embed, /api/pull, …) alongside OpenAI and Anthropic, your existing Ollama-connected tools — Raycast, Obsidian, Enchanted, Open WebUI, ollama-python/js — work unchanged: point them at http://localhost:11234 and keep your workflow, on a faster engine.\n\nmlx-serve is an open-source project written primarily in Zig, with 337 stars on GitHub. It was last updated in July 2026.\n\n```\nbrew install --cask mlx-core   # GUI menu bar app\n```\n\n## mlx-serve vs. the alternatives\n\n[All agent infrastructure →](/category/agent-infrastructure)", "url": "https://wpnews.pro/news/mlx-serve-shipped-an-update", "canonical_source": "https://agentsearchengine.app/agents/mlx-serve", "published_at": "2026-07-17 23:25:52+00:00", "updated_at": "2026-07-21 01:37:45.341881+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-tools", "developer-tools"], "entities": ["mlx-serve", "Apple Silicon", "MLX Core", "OpenAI", "Anthropic", "Ollama", "HuggingFace", "LM Studio"], "alternates": {"html": "https://wpnews.pro/news/mlx-serve-shipped-an-update", "markdown": "https://wpnews.pro/news/mlx-serve-shipped-an-update.md", "text": "https://wpnews.pro/news/mlx-serve-shipped-an-update.txt", "jsonld": "https://wpnews.pro/news/mlx-serve-shipped-an-update.jsonld"}}