{"slug": "portable-ai-on-a-usb-stick", "title": "Portable AI on a USB Stick", "summary": "A developer created a portable AI agent that fits on a USB stick, bundling Python, Ollama, and memory into a 340MB self-contained package for x86_64 Linux. By stripping GPU libraries and using relative paths, the agent runs without system dependencies, offering CPU-only inference and memory persistence across sessions.", "body_md": "#\nPortable AI on a USB Stick\n\nPackage an AI agent with bundled Python, Ollama, and memory into a 340MB self-contained package that runs on any x86_64 Linux machine.\n\n##\nStructure\n\n##\nKey Decisions\n\n- CPU-only Ollama — stripped GPU libs, saves 5GB\n- Bundled venv — no system Python needed\n- Relative paths — works from any mount point\n- Model download on first run\n\n##\nResults\n\n- Full agent runtime with memory, tools, HTTP API\n- Ollama inference (CPU mode)\n- Memory persistence across sessions\n- No system dependencies required\n\nPortable AI is possible today. Bundle the runtime, strip the GPU libs, use relative paths.", "url": "https://wpnews.pro/news/portable-ai-on-a-usb-stick", "canonical_source": "https://dev.to/noraxai/portable-ai-on-a-usb-stick-2k6n", "published_at": "2026-06-27 22:44:12+00:00", "updated_at": "2026-06-27 23:33:30.058788+00:00", "lang": "en", "topics": ["artificial-intelligence", "developer-tools", "ai-agents", "ai-infrastructure"], "entities": ["Ollama", "Linux"], "alternates": {"html": "https://wpnews.pro/news/portable-ai-on-a-usb-stick", "markdown": "https://wpnews.pro/news/portable-ai-on-a-usb-stick.md", "text": "https://wpnews.pro/news/portable-ai-on-a-usb-stick.txt", "jsonld": "https://wpnews.pro/news/portable-ai-on-a-usb-stick.jsonld"}}