{"slug": "ghostos-lightweight-offline-desktop-ai-assistant-macos-win-linux", "title": "GhostOS – Lightweight, Offline Desktop AI Assistant (macOS/Win/Linux)", "summary": "GhostOS-ai released GhostOS, an open-source offline desktop AI assistant for macOS, Windows and Linux that targets low-spec laptops and base Apple Silicon Macs with 4GB–8GB of RAM. GhostOS-ai says the app's native webview interface (WebKit, Edge WebView2, WebKitGTK) uses about 35MB of RAM, its Dynamic VRAM Juggler hot-swaps between LLM, vision and Whisper models in under 150ms with peak VRAM capped at 3.5GB, and its Zero-DB RAG indexes dropped files using SQLite FTS5 with no external database. GhostOS-ai positions the tool against Electron-based apps such as LM Studio, Jan and AnythingLLM, which it says consume 800MB–1.2GB of RAM on the UI alone, and claims zero telemetry and full air-gapped operation.", "body_md": "\n\n```\n      .---.\n     /     \\\n    | () () |   G H O S T O S\n     \\  -  /    The Invisible, Featherweight, Offline Desktop AI Copilot\n    /`---'\\\n   /       \\    [ 100% Private • Dynamic VRAM Juggler • Zero-DB RAG • Casper Pet ]\n  (_/^\\_/\\_/^)\n```\n\n**🌐 Language Select / Выбор языка / Тілді таңдау / 语言选择:**\n\n[**English**](https://github.com/GhostOS-ai/GhostOS/blob/main/README.md) •\n  [**Русский**](https://github.com/GhostOS-ai/GhostOS/blob/main/docs/README_RU.md) •\n  [**Қазақша**](https://github.com/GhostOS-ai/GhostOS/blob/main/docs/README_KK.md) •\n  [**简体中文**](https://github.com/GhostOS-ai/GhostOS/blob/main/docs/README_ZH.md) •\n  [**Español**](https://github.com/GhostOS-ai/GhostOS/blob/main/docs/README_ES.md) •\n  [**Deutsch**](https://github.com/GhostOS-ai/GhostOS/blob/main/docs/README_DE.md) •\n  [**Français**](https://github.com/GhostOS-ai/GhostOS/blob/main/docs/README_FR.md) •\n  [**日本語**](https://github.com/GhostOS-ai/GhostOS/blob/main/docs/README_JA.md) •\n  **Português**\n\n**A unified, ultra-lightweight desktop AI companion that runs effortlessly on low-spec laptops and base Apple Silicon Macs (4GB–8GB RAM) without Out-Of-Memory (OOM) crashes.**\n\n[Quickstart](#-quickstart) • [Features](#-exclusive-killer-features) • [Comparison](#-why-ghostos-vs-others) • [Architecture](#-architecture) • [CLI Cheatsheet](#-cli-cheatsheet) • [Privacy Pledge](#-100-paranoid-privacy-pledge)\n\nRunning local AI today is frustrating and bloated:\n\n- **Electron RAM Bloat:** Most local AI desktop apps (LM Studio, Jan, AnythingLLM) burn**800MB–1.2GB of RAM** on the UI alone before a single neural weight is loaded into memory.\n- **The Multi-Model OOM Trap:** Trying to run an LLM (3GB) + Vision model (2GB) + Whisper (1GB) simultaneously crashes any device with 4GB–8GB RAM.\n- **Overcomplicated RAG Stacks:** Document chat tools force users to install Docker containers, heavy vector databases (Chroma/Qdrant), and gigabytes of bloated Python dependencies.\n\n**GhostOS solves this from first principles:**\n\n1. **Casper Companion Pet & HUD:** Rendered via native system web engines (WebKit on macOS, Edge WebView2 on Windows, WebKitGTK on Linux) consuming just**~35MB RAM** .\n2. **Dynamic VRAM Juggler:** Dynamically hot-swaps between LLM, Vision, and Whisper on demand in <150ms. Peak VRAM never exceeds**3.5GB** .\n3. **Zero-DB RAG:** Drop files onto Casper — indexed in milliseconds using pure**SQLite FTS5** with zero external database dependencies.\n4. **100% Local & Private:** Zero telemetries, zero cloud fallbacks. Fully functional air-gapped with Wi-Fi switched off.\n\n- A quiet, translucent porcelain ghost that floats gently over your workspace.\n- **\"Casper Eats Files\":** Drag & drop any PDF, code repository, notes, or spreadsheet directly onto Casper. Casper opens his mouth, swallows the file, and indexes it into your local knowledge base instantly (+15 XP!).\n- **Visual Moods & Reactive States:**  - 💤 `Idle` : Weightless floating animation, 0% CPU footprint.\n  - 🔮 `Thinking` : Ethereal sapphire aura, streaming local neural tokens.\n  - 🎧 `Listening` : Casper wears glowing headphones, capturing offline meetings.\n  - 🍕 `Eating` : Document suction animation with real-time XP gain.\n  - ⚠️ `Alarm` : Visual security warning when a dangerous shell command is detected.\n- 💤 \n- Single-click for quick phrases & interactions; double-click or press `Cmd+Shift+Space` /`Ctrl+Shift+Space` to morph into the**Spotlight HUD** .\n\n- Highlight text anywhere (Word, Telegram, browser, IDE, terminal) $\\rightarrow$ press hotkey$\\rightarrow$ transform instantly:\n  - ✨ `polish` : Professional, crisp, and concise rewrite.\n  - 🤝 `polite` : Diplomatic, respectful business tone.\n  - 📝 `grammar` : Fixes spelling and grammar mistakes with zero conversational fluff.\n  - 🎯 `summarize` : Distills text down to 2-3 key takeaways.\n  - 🌐 `translate` : Instant translation into English, Russian, Kazakh, Chinese, etc.\n  - 🛠️ `code_fix` : Automatically diagnoses and fixes bugs in code snippets.\n- ✨ \n- Use from CLI: `ghost write --mode polite \"draft message\"` or rewrite clipboard in 1 click!\n\n- Local SQLite knowledge graph that permanently stores personal context across restarts.\n- Casper automatically remembers your developer stack, favorite languages, and active projects.\n- Injects personal context into queries with **0 KB extra VRAM** and 0% background CPU footprint.\n- CLI: `ghost vault list` ,`ghost vault remember tech_stack \"Python, Rust, Apple Silicon\"` .\n\n- Deep safety inspection for shell commands before execution.\n- Intercepts and blocks destructive operations (`rm -rf /` ,`mkfs` , raw`dd` ,`DROP DATABASE` ,`format C:` ).\n- Explains risks in plain human language and suggests safe alternatives before running.\n- Interactive audit: `ghost sandbox \"rm -rf /\"` .\n\n- Analyzes daily workspace file modifications, git diffs, and session commits.\n- Generates ready-to-share Daily Standup reports for Slack / Telegram (*\"What I accomplished\", \"What I'm working on\", \"Blockers\"* ).\n- Automatically crafts semantic Conventional Commits (`feat(...)` ,`fix(...)` ,`refactor(...)` ).\n- CLI: `ghost standup` .\n\n- 100% private offline secretary for Zoom, Google Meet, and voice notes.\n- Generates structured markdown meeting minutes with **Executive Overview** ,**Key Decisions** , and**Action Items with Deadlines** .\n- Whisper model hot-swaps in only for the 5-second transcription window and immediately frees VRAM.\n\n- Dynamically monitors battery state and system RAM pressure:\n  - 🍃 **ECO Mode:** Triggers on battery or RAM > 82%. Context capped at 1024 tokens, 2 CPU threads, 60s auto-sleep, 30 FPS pet.\n  - ⚖️ **Balanced Mode:** Context 2048 tokens, 4 threads, 180s auto-sleep.\n  - ⚡ **Performance Beast:** On AC power and free RAM > 50%. Context 4096 tokens, full GPU acceleration.\n- 🍃 \n\n- Gamified companion that grows with your work:\n  - Gain XP for feeding files (+15 XP), running commands (+25 XP), asking questions (+10 XP).\n  - Unlocks evolutions and visual accessories (Cyberpunk Visor, Magic Spellbook, Golden Crown).\n\n| Feature | GhostOS 👻 | Jan.ai / LM Studio | Ollama | AnythingLLM | \n|---|---|---|---|---|\n| **GUI Memory Footprint** | **~35 MB** (Native Engine) | ~850 MB (Electron) | None (CLI only) | ~1.1 GB (Electron + DB) | \n| **Desktop Pet Companion** | **Yes (Casper RPG)** | ❌ No | ❌ No | ❌ No | \n| **Drag & Drop RAG Ingestion** | **Yes (Drop onto Pet)** | ❌ Manual upload | ❌ Manual import | ❌ Manual upload | \n| **Dynamic VRAM Swapping** | **Yes (VRAM Juggler)** | ❌ OOM on low VRAM | ❌ Manual CLI | ❌ OOM on low VRAM | \n| **KV-Cache Disk Freezer** | **Yes (0 MB idle VRAM)** | ❌ No | ❌ No | ❌ No | \n| **Context Vacuum (Pruning)** | **Yes (Saves 40-60%)** | ❌ No | ❌ No | ❌ No | \n| **Adaptive Battery Profiles** | **Yes (Chameleon Mode)** | ❌ No | ❌ No | ❌ No | \n| **Inline AI Ghostwriter** | **Yes (Any desktop app)** | ❌ No | ❌ No | ❌ No | \n| **Terminal Sandbox Lens** | **Yes (Safety protection)** | ❌ No | ❌ No | ❌ No | \n| **Daily Standup / Commit Crafter** | **Yes (Built-in)** | ❌ No | ❌ No | ❌ No | \n| **External DB Requirement** | **Zero (SQLite FTS5)** | Varies | None | Requires Vector DB / Chroma | \n| **Cross-Platform (macOS/Win/Linux)** | **Yes** | Yes | Yes | Yes | \n| **Works 100% Offline** | **Yes** | Yes | Yes | Mostly | \n\n```\ngit clone https://github.com/GhostOS-ai/GhostOS.git\ncd GhostOS\npip install -e .\nghost pet\n```\n\n*Casper will float on your desktop. Drag any file onto him, or click him to open the HUD!*\n\n```\n# Instant question with zero setup\nghost \"Why does Python raise RecursionError and how to fix it?\"\n\n# Feed a document or source directory to Casper (Zero-DB RAG)\nghost eat ~/Documents/my_notes.txt\nghost eat ./src/\n\n# Inline AI Ghostwriter (rewrites clipboard or given text)\nghost write --mode polite \"can you fix this asap\"\nghost write --mode grammar\n\n# Long-term Memory Vault\nghost vault remember tech_stack \"Python, Rust, Apple Silicon\"\nghost vault list\n\n# Daily Standup Report & Semantic Commit Crafter\nghost standup\n\n# Terminal Sandbox Safety Lens\nghost sandbox \"rm -rf /\"\n\n# Search indexed knowledge\nghost rag search \"database migration\"\n\n# Inspect current active screen\nghost screen\n\n# Generate and safely run a terminal task\nghost exec \"find all files larger than 100MB\"\n\n# Check VRAM Juggler memory diagnostics\nghost status\n```\n\n| Shortcut | Action | \n|---|---|\n| `Cmd + Shift + Space` /`Ctrl + Shift + Space` | Toggle Spotlight HUD | \n| `Click Ghost` | Talk with Casper / Pet reaction | \n| `Double Click Ghost` | Open Quick Command HUD | \n| `Escape` | Minimize back to Floating Casper | \n| `Enter` | Submit query | \n| `Drag & Drop File` | Feed document to Casper (Instant RAG) | \n\n``` php\nflowchart TD\n    User([User Desktop]) -->|Drag & Drop File / Click| Pet[\"👻 Casper Floating Pet (Native Engine)\"]\n    User -->|Hotkey Cmd+Shift+Space| HUD[\"🔮 Spotlight HUD / Command Bar\"]\n    User -->|Terminal CLI| CLI[\"💻 ghost CLI (rich)\"]\n\n    Pet --> Bridge[\"Python <-> JS Bridge API\"]\n    HUD --> Bridge\n    CLI --> Core[\"GhostOS Core Engine\"]\n    Bridge --> Core\n\n    subgraph MemoryManagement [\"🧠 VRAM Juggler & Memory Chameleon\"]\n        Core --> Juggler[\"Memory Juggler Dispatcher\"]\n        Juggler -->|Hot-Swap <= 3.5GB| M1[\"Qwen 2.5 / Llama 3.2 (LLM)\"]\n        Juggler -->|Hot-Swap <= 2.0GB| M2[\"Moondream2 / MiniCPM (Vision)\"]\n        Juggler -->|Hot-Swap <= 0.6GB| M3[\"Whisper (Voice Copilot)\"]\n    end\n\n    subgraph Storage [\"📂 Zero-DB Storage & Vault\"]\n        Core --> RAG[\"SQLite FTS5 Knowledge Base\"]\n        Core --> Vault[\"🧠 Memory Vault (Long-Term Facts)\"]\n        RAG --> Docs[(\"Local Notes / Code / PDFs\")]\n    end\n\n    subgraph OSIntegration [\"⚡ System Integration\"]\n        Core --> Screen[\"Silent Screen Inspector\"]\n        Core --> Pilot[\"Safe Terminal Autopilot\"]\n        Core --> Lens[\"🛡️ Sandbox Lens\"]\n        Core --> Writer[\"✍️ Ghostwriter Engine\"]\n    end\n```\n\nGhostOS is engineered with privacy as a foundational constraint:\n\n- **Zero Telemetry:** No analytics, no phone-home pings, no user tracking.\n- **Zero Cloud Fallbacks:** Every neural calculation runs locally on your device's CPU/GPU.\n- **Air-Gapped Ready:** Works with your Wi-Fi completely disabled.\n\nContributions are warmly welcomed! Feel free to submit issues, pull requests, or custom Casper skins.\n\n```\n# Run full unit test suite (44+ tests)\npython3 -m unittest discover tests\n```\n\n- **Author:**[KIB.best](https://kib.best)\n- **Email:**[GhostOS@kib.best](mailto:GhostOS@kib.best)\n- **License:** MIT License © 2026 KIB.best. Free for personal and commercial use.", "url": "https://wpnews.pro/news/ghostos-lightweight-offline-desktop-ai-assistant-macos-win-linux", "canonical_source": "https://github.com/GhostOS-ai/GhostOS", "published_at": "2026-10-18 15:08:54+00:00", "updated_at": "2026-10-18 15:48:23.386654+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-tools", "ai-products", "large-language-models", "ai-agents"], "entities": ["GhostOS", "GhostOS-ai", "LM Studio", "Jan", "AnythingLLM", "SQLite FTS5", "Whisper", "Apple Silicon"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/ghostos-lightweight-offline-desktop-ai-assistant-macos-win-linux", "markdown": "https://wpnews.pro/news/ghostos-lightweight-offline-desktop-ai-assistant-macos-win-linux.md", "text": "https://wpnews.pro/news/ghostos-lightweight-offline-desktop-ai-assistant-macos-win-linux.txt", "jsonld": "https://wpnews.pro/news/ghostos-lightweight-offline-desktop-ai-assistant-macos-win-linux.jsonld"}}