{"slug": "build-your-own-jarvis-with-5-free-tools-setup-guide", "title": "Build your own JARVIS with 5 free tools: setup guide", "summary": "A developer published a setup guide for assembling a local, self-hosted AI assistant from five free components: Ollama running Qwen3 as the model backend, Open WebUI as the chat interface, faster-whisper for speech-to-text, kokoro-onnx for text-to-speech, and goose for MCP-based skills, with Obsidian Markdown notes as memory. The guide stresses that the pieces are separate tools the user must wire together, that no single JARVIS works out of the box, and that performance depends on hardware, recommending a small model such as qwen3:4b to start. It documents verified integrations between Open WebUI and Ollama and between goose and Ollama, and notes Open WebUI's built-in local Whisper for browser voice input.", "body_md": "Commands checked on the official pages and READMEs on 30 Oct 2026. Star counts are from 29 Oct 2026.\n\n**What you're building:** a local AI assistant that has a brain (Ollama + Qwen3), a chat screen (Open WebUI), ears (faster-whisper), a voice (kokoro-onnx), skills (goose) and memory (Obsidian notes).\n\n**Honest caveat:** these are separate tools. You install them and wire them together yourself; none of this works as one JARVIS out of the box. Speed depends on your hardware, so start with a small model.\n\nOllama: [https://github.com/ollama/ollama](https://github.com/ollama/ollama) · MIT · 185K★\nQwen3: [https://ollama.com/library/qwen3](https://ollama.com/library/qwen3) · Apache-2.0\n\nmacOS / Linux:\n\n```\ncurl -fsSL https://ollama.com/install.sh | sh\n```\n\nWindows (PowerShell):\n\n```\nirm https://ollama.com/install.ps1 | iex\n```\n\nStart with a small model:\n\n```\nollama run qwen3:4b\n```\n\n- Ollama's local API runs at `http://localhost:11434` .\n- Skip models tagged `:cloud` , because they don't run on your machine.\n\n[https://github.com/open-webui/open-webui](https://github.com/open-webui/open-webui) · Open WebUI License (BSD-3-style with a branding clause; free and self-hosted) · 157K★\n\nYou need **Python 3.12**.\n\n```\npip install open-webui\nopen-webui serve\n```\n\n- Open [http://localhost:8080](http://localhost:8080) .\n- On first run you create a local admin account. It stays on your machine; there is no cloud signup.\n- With Ollama running, choose `qwen3:4b` in the model picker. To use Ollama on another machine, the README shows the`OLLAMA_BASE_URL` setting.\n\n[https://github.com/SYSTRAN/faster-whisper](https://github.com/SYSTRAN/faster-whisper) · MIT · 26.3K★ · needs Python 3.9+\n\n```\npip install faster-whisper\npython\nfrom faster_whisper import WhisperModel\nmodel = WhisperModel(\"small\", device=\"cpu\", compute_type=\"int8\")\nsegments, info = model.transcribe(\"audio.mp3\", beam_size=5)\nfor s in segments: print(s.text)\n```\n\n- It runs on CPU. On an NVIDIA GPU it needs CUDA 12 and cuDNN 9.\n\n[https://github.com/thewh1teagle/kokoro-onnx](https://github.com/thewh1teagle/kokoro-onnx) · MIT · 2.8K★ · the Kokoro-82M model is Apache-2.0\n\n```\npip install -U kokoro-onnx soundfile\nwget https://github.com/thewh1teagle/kokoro-onnx/releases/download/model-files-v1.1/kokoro-v1.0.onnx\nwget https://github.com/thewh1teagle/kokoro-onnx/releases/download/model-files-v1.1/voices-v1.0.bin\npython\nimport soundfile as sf\nfrom kokoro_onnx import Kokoro\nkokoro = Kokoro(\"kokoro-v1.0.onnx\", \"voices-v1.0.bin\")\nsamples, sr = kokoro.create(\"Hello, I am your assistant.\", voice=\"af_sarah\", speed=1.0, lang=\"en-us\")\nsf.write(\"audio.wav\", samples, sr)\n```\n\n[https://github.com/aaif-goose/goose](https://github.com/aaif-goose/goose) · Apache-2.0 · 55.9K★\n\n```\ncurl -fsSL https://github.com/aaif-goose/goose/releases/download/stable/download_cli.sh | bash\ngoose configure\n```\n\n- There is also a desktop app: [https://goose-docs.ai/docs/getting-started/installation](https://goose-docs.ai/docs/getting-started/installation)\n- In `goose configure` , pick**Ollama** as the provider. Your local models appear automatically, so no API key is needed. Cloud providers do need keys.\n- goose adds skills through MCP extensions.\n\n[https://obsidian.md](https://obsidian.md) · free for all purposes, no sign-up needed · **not open source**\n\n- Download it from obsidian.md and create a vault (a folder).\n- Your notes are stored locally as plain text Markdown files, so any tool that reads files can use them.\n- Sync and Publish are paid add-ons and you don't need them.\n\n- **Open WebUI ↔ Ollama:** verified (Open WebUI README). Your Ollama models show up in its chat.\n- **goose ↔ Ollama:** verified (goose provider docs).\n- **Open WebUI voice (no code):** its audio docs (docs.openwebui.com/troubleshooting/audio) say speech-to-text uses a built-in local Whisper when the engine is left empty, and they describe its compute settings as faster-whisper's. So you can talk to it in the browser. In your own Audio settings you can also pick \"Kokoro.js (Browser)\" for a local in-browser voice. That is Kokoro running in the browser, not the kokoro-onnx package from step 4, which has no verified link to Open WebUI.\n- **faster-whisper and kokoro-onnx ↔ goose:** not verified. You'd write a small script that sends the transcribed text in and speaks the reply.\n- **Obsidian ↔ goose or Open WebUI:** not verified as a built-in link. The notes are plain markdown files, so point your tools at the vault folder.", "url": "https://wpnews.pro/news/build-your-own-jarvis-with-5-free-tools-setup-guide", "canonical_source": "https://gist.github.com/Syedmudassir1604/512684147667ecd5e6cc9843e4277a48", "published_at": "2026-10-30 14:50:42+00:00", "updated_at": "2026-11-01 14:51:29.180229+00:00", "lang": "en", "topics": ["ai-tools", "large-language-models", "ai-agents", "agent-protocols", "ai-products"], "entities": ["Ollama", "Qwen3", "Open WebUI", "faster-whisper", "kokoro-onnx", "goose", "Obsidian", "SYSTRAN"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/build-your-own-jarvis-with-5-free-tools-setup-guide", "markdown": "https://wpnews.pro/news/build-your-own-jarvis-with-5-free-tools-setup-guide.md", "text": "https://wpnews.pro/news/build-your-own-jarvis-with-5-free-tools-setup-guide.txt", "jsonld": "https://wpnews.pro/news/build-your-own-jarvis-with-5-free-tools-setup-guide.jsonld"}}