{"slug": "show-hn-i-built-ai-command-center-to-run-all-local-models-in-one-place", "title": "Show HN: I Built AI command center to run all local models in one place", "summary": "Generative IDE released GIDE v2.3.6, an AI coding agent that runs entirely offline on the user's machine with zero token cost, featuring a write gate that requires approval before any file change and supports any local model, including the bundled Ornith 9B. The tool provides a CLI, an editor, and an OpenAI-compatible local API endpoint, allowing existing OpenAI SDK tools to connect without modification.", "body_md": "[v2.3.6What's new](/changelog)\n\n# The coding agent that runs on your machine.\n\nOffline, at zero token cost, with your choice of model, and it asks before it changes a single line.\n\nA real recorded session. The edit is waiting on you. Keep it or undo it.\n\n[Windows install →](/cli)\n\n`$ curl -fsSL https://generativeide.com/install.sh | sh`\n\n## See it do the work\n\nReal sessions, recorded from the running agent, the same tool calls, diffs and approval gates you get after you install it. Pick a job and watch it happen.\n\nThe work you actually do all day, across files, with the tests run and the diff shown.\n\n### Dropped into an unfamiliar codebase, it maps it before it answers\n\nSemantic retrieval across the whole repo rather than a guess from the file names. It reads what it needs, then tells you how the pieces fit.\n\nThe write gate\n\n## Nothing is written until you say so\n\nAn agent that edits your repo behind your back is a liability. Every file write and every shell command stops here first, with the diff in front of you. Accept it, allow the rest of the session, or reject it, and a rejection is fed back to the agent so it tries something else rather than silently giving up.\n\n- ✓The same gate in the editor, in the CLI, and in CI\n- ✓Identical whether the model is local or your own cloud key\n- ✓Every decision lands in a local JSONL audit log\n\n[How the gate works →](/docs)\n\nThis one is live, click it, or tab to it and use the arrow keys.\n\n## Any model, one command\n\nRunning a real local LLM usually means a package manager, a Python environment and a GPU toolchain. Here it means opening the app. The harness above the model, plan gate, write gate, memory, tools, never changes.\n\n### Ornith 9B\n\nThe default. It ships with GIDE, so the first time you open the editor there is a working local model and nothing to install. No ollama, no Python environment, no CUDA toolkit, no config file.\n\nZero token cost, no rate limit, and it keeps working with the wifi off. [Full memory and context matrix](/multi-model)\n\nGide CLI · v2.3.6\n\n## The same agent, in your terminal\n\nGide is not only an editor. The CLI runs the same local model, shares the same conversation history, and approves every edit through the same gate. Use it next to neovim, inside CI, or alongside the app itself.\n\n- ✓Runs offline on your hardware, so no tokens are billed and no code leaves the machine\n- ✓Scriptable with real exit codes, so it pipes and composes like any other shell tool\n- ✓Ships an OpenAI-compatible endpoint, so your own tools can use the local model\n- ✓macOS, Linux and Windows\n\n`$ curl -fsSL https://generativeide.com/install.sh | sh`\n\nWindows: [PowerShell and CMD commands](/cli)\n\nLocal OpenAI-compatible API\n\n## Your laptop, speaking the OpenAI API\n\nMint a key, point any OpenAI SDK at 127.0.0.1, and every tool you have already built against that protocol runs on the model sitting on your own machine. No rewrite, no gateway, no per-token bill.\n\nStep one, mint a key\n\nThe endpoint is bound to 127.0.0.1. There is no hop to us, because there is no us in the path.\n\nReasoning models return their thinking in its own field rather than smeared through the answer.\n\nEvery key's usage shows up in gide usage, and on a local model the bill is still zero.\n\nRevoking a key takes effect immediately. A busy model answers 429 with a retry header instead of queueing forever.\n\nStep two, point anything at it\n\n``` python\nfrom openai import OpenAI\n\nclient = OpenAI(\n    base_url=\"http://127.0.0.1:41337/v1\",\n    api_key=\"sk-gide-...\",          # gide apikey create my-tool\n)\n\nstream = client.chat.completions.create(\n    model=\"local\",\n    messages=[{\"role\": \"user\", \"content\": \"summarise this changelog\"}],\n    stream=True,\n)\nfor chunk in stream:\n    print(chunk.choices[0].delta.content or \"\", end=\"\")\n```\n\nThe port is whichever one GIDE is listening on, gide apikey create prints the full base URL. This is raw model access: your prompt, your history, and none of GIDE's agent harness or memory. Tool calling, multiple completions, response formats and logprobs are not supported and each returns a clear error. The endpoint is disabled while Private Cloud is connected. [API reference](/docs)\n\n## Stop Paying for Every Single Token.\n\nCloud-based AI IDEs charge you per line of code generated, effectively punishing you for being productive. As models get larger, these costs will only rise.\n\nRun powerful AI models locally on your hardware. Pay for the electricity, not the intelligence. Never see an API bill again.\n\nCode entirely without limits. Enjoy complete freedom with zero rate limiting, no daily caps, and no throttling during peak hours.\n\n### Cost Projection\n\nGIDE vs. Cloud AI Providers\n\nProjected costs based on 1 million tokens generated compared to average cloud provider rates.\n\n$0. Forever.\n\n[Download GIDE](/download)\n\n## Powerful Features, Zero Cloud\n\nA local-first, private, agentic IDE with your choice of model.\n\n### Agent Mode\n\nGive it a task, not a line to change. Describe a goal and GIDE plans the work, edits across files, runs commands, and verifies its own output, shipping the whole change end to end.\n\n### Fully Offline & Private\n\nA real LLM running on your machine. No content telemetry, zero cloud round-trips. Your code stays on your machine — we collect aggregate usage counts, never code or prompts. The agentic IDE that actually runs on your laptop.\n\n### Your Model, Your Choice\n\nSwitch between on-device models (Ornith, Qwen, Gemma, DeepSeek) and frontier models (Claude, GPT, Gemini) with your own key. Private by default, frontier power on demand.\n\n### Codebase Context & Persistent Memory\n\nSemantic retrieval (RAG) over your whole repo, plus persistent memory management that carries context across sessions, so it remembers where you left off.\n\n### Skills & Tool Connections\n\nTeach it your team's conventions with skill files, and connect external tools over MCP (like OpenShell) so the agent acts beyond the editor.\n\n## Frequently Asked Questions\n\n### Can GIDE run fully offline?\n\nYes. GIDE bundles a local model that runs entirely on your machine via llama.cpp, no internet needed, and your code and prompts never leave it. You can also connect a cloud model with your own API key when you want frontier-model power; the app says so plainly when you do. The only things that need the network in local mode are login and update checks. Read the [documentation](/docs) for architecture details.\n\n### Do I need to pay for AI tokens?\n\nNot for local models: they run on your hardware, so there are no per-token charges no matter how much you use them. If you connect a cloud model with your own key, you pay that provider directly at their rates. New users get a 30-day free trial on any paid plan. [Download and try it](/download) , no credit card required to start.\n\n### What AI model does GIDE use?\n\nGIDE is model-agnostic. Ornith 9B ships bundled and works on first launch; Qwen, Gemma and DeepSeek are one command away, and you can point it at any GGUF file you like, all running through [llama.cpp](https://github.com/ggerganov/llama.cpp) with GPU acceleration on NVIDIA (CUDA) and Apple Silicon (Metal). Claude, GPT and Gemini work too, with your own key. The agentic harness is identical either way, see the [memory and context matrix](/multi-model) for what runs on your hardware.\n\n### Is GIDE suitable for regulated or air-gapped environments?\n\nYes. By default, no network calls are required for core AI features. GIDE includes JSONL audit telemetry, bearer-token authentication, and folder trust. Built for developers in regulated environments who need code to stay on-device. Have specific requirements? [Contact us](/contact).\n\n## Start building offline\n\nFree to download, a 30-day trial on any paid plan, and no credit card to begin.\n\nBuilt on [VS Code OSS](https://github.com/microsoft/vscode), powered by [llama.cpp](https://github.com/ggerganov/llama.cpp).", "url": "https://wpnews.pro/news/show-hn-i-built-ai-command-center-to-run-all-local-models-in-one-place", "canonical_source": "https://generativeide.com/", "published_at": "2026-09-01 03:41:48+00:00", "updated_at": "2026-09-01 03:52:03.128620+00:00", "lang": "en", "topics": ["ai-agents", "developer-tools", "ai-products"], "entities": ["Generative IDE", "GIDE", "Ornith 9B"], "alternates": {"html": "https://wpnews.pro/news/show-hn-i-built-ai-command-center-to-run-all-local-models-in-one-place", "markdown": "https://wpnews.pro/news/show-hn-i-built-ai-command-center-to-run-all-local-models-in-one-place.md", "text": "https://wpnews.pro/news/show-hn-i-built-ai-command-center-to-run-all-local-models-in-one-place.txt", "jsonld": "https://wpnews.pro/news/show-hn-i-built-ai-command-center-to-run-all-local-models-in-one-place.jsonld"}}