cd /news/artificial-intelligence/looking-for-recommendations-for-an-o… · home › topics › artificial-intelligence › article
[ARTICLE · art-88758] src=discuss.huggingface.co ↗ pub= topic=artificial-intelligence verified=true sentiment=· neutral

Looking for Recommendations for an Open Source AI on a USB Stick

A user is seeking recommendations for building a USB stick that runs an open source AI model locally, asking for advice on which models and software stack to use, as well as packaging and running from a USB drive.

read1 min views1 publishedAug 8, 2026
Looking for Recommendations for an Open Source AI on a USB Stick
Image: Discuss (auto-discovered)

I’m looking to build a USB stick that runs an open source AI model locally. There are so many options available that I’m not sure where to start.

Can anyone recommend which open source models and software stack would be best for this? I’m also interested in any guidance on the best way to package and run it from a USB drive.

Thanks in advance!

source & further reading
discuss.huggingface.co — original article Rakarrack-0.6.1 port making progress! ( AI assisted ) Cloud Storage Poll Welcome to Haiku basic(Haiku Docs, Haiku slide and Haiku sheets)
── more in #artificial-intelligence 4 stories · sorted by recency
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/looking-for-recommen…] indexed:0 read:1min 2026-08-08 · —