{"slug": "nexusos-your-personal-jarvis-powered-by-ai", "title": "NexusOS — Your Personal Jarvis, Powered by AI", "summary": "A developer built NexusOS, a locally running AI-powered operating environment that responds to the wake word \"Hey Nexus\" and executes voice or text commands to control a computer. The system combines Whisper speech recognition, PyAutoGUI computer control, Playwright browser automation, MQTT smart-home integration, and vector-embedding memory, with a Python/FastAPI backend and React frontend running in Docker. The project is available on GitHub.", "body_md": "Have you ever wanted a Jarvis? Not a toy demo, but something that actually controls your computer, understands what you're asking, and takes action? That's exactly what I built with NexusOS\n\nNexusOS is an AI-powered operating environment that runs locally. You say \"Hey Nexus\", it wakes up, listens, figures out what you want, and does it. Open Chrome, search for something, move files around, run a script, or control your smart home devices — all through voice or text, without touching the keyboard\n\n🛠️ What it does:\n\nVoice Pipeline — Listens for a wake word, transcribes with Whisper, and speaks back using TTS. The whole loop takes about 2-3 seconds [2†L14-L17].\n\nComputer Control — Moves your mouse, clicks buttons, and types text using PyAutoGUI\n\nBrowser Automation — Built on Playwright, it can open browsers, navigate, fill forms, and read page content back to you [2†L20-L22].\n\nFile Management — Create, move, rename, search, and delete files through voice commands .\n\nAutonomous Workflows — Define multi-step routines like \"morning routine\" that run in sequence .\n\nAI Memory — Remembers things across sessions using vector embeddings, so it actually knows context from previous conversations .\n\nSmart Home — Connects to MQTT, working with Home Assistant and most IoT devices .\n\nPlugin System — Drop a Python file into the plugins folder and it loads automatically .\n\n🧰 Tech Stack\n\nThe backend is Python with FastAPI, Whisper for speech recognition, PyAutoGUI for computer control, Playwright for browser automation, and SQLite with vector embeddings for memory. The frontend is React with Tailwind CSS. Everything runs in Docker .\n\n🔗 Get Started\n\nCheck out the repo: ([https://github.com/isidhartha/nexus-os](https://github.com/isidhartha/nexus-os))", "url": "https://wpnews.pro/news/nexusos-your-personal-jarvis-powered-by-ai", "canonical_source": "https://dev.to/isidhartha/nexusos-your-personal-jarvis-powered-by-ai-2cb3", "published_at": "2026-09-11 09:21:59+00:00", "updated_at": "2026-09-11 09:33:23.000585+00:00", "lang": "en", "topics": ["ai-agents", "ai-tools", "ai-products", "natural-language-processing", "developer-tools"], "entities": ["NexusOS", "Whisper", "PyAutoGUI", "Playwright", "FastAPI", "Home Assistant", "MQTT", "GitHub"], "alternates": {"html": "https://wpnews.pro/news/nexusos-your-personal-jarvis-powered-by-ai", "markdown": "https://wpnews.pro/news/nexusos-your-personal-jarvis-powered-by-ai.md", "text": "https://wpnews.pro/news/nexusos-your-personal-jarvis-powered-by-ai.txt", "jsonld": "https://wpnews.pro/news/nexusos-your-personal-jarvis-powered-by-ai.jsonld"}}