Portable AI on a USB Stick

A developer created a portable AI agent that fits on a USB stick, bundling Python, Ollama, and memory into a 340MB self-contained package for x86_64 Linux. By stripping GPU libraries and using relative paths, the agent runs without system dependencies, offering CPU-only inference and memory persistence across sessions.

Portable AI on a USB Stick Package an AI agent with bundled Python, Ollama, and memory into a 340MB self-contained package that runs on any x86 64 Linux machine. Structure Key Decisions - CPU-only Ollama — stripped GPU libs, saves 5GB - Bundled venv — no system Python needed - Relative paths — works from any mount point - Model download on first run Results - Full agent runtime with memory, tools, HTTP API - Ollama inference CPU mode - Memory persistence across sessions - No system dependencies required Portable AI is possible today. Bundle the runtime, strip the GPU libs, use relative paths.