#

Portable AI on a USB Stick

Package an AI agent with bundled Python, Ollama, and memory into a 340MB self-contained package that runs on any x86_64 Linux machine.

#

Structure

#

Key Decisions

• CPU-only Ollama — stripped GPU libs, saves 5GB
• Bundled venv — no system Python needed
• Relative paths — works from any mount point
• Model download on first run

#

Results

• Full agent runtime with memory, tools, HTTP API
• Ollama inference (CPU mode)
• Memory persistence across sessions
• No system dependencies required

Portable AI is possible today. Bundle the runtime, strip the GPU libs, use relative paths.