I put seven LLMs on a USB stick. Here is everything that broke.
A developer documented building a portable USB stick that runs seven local language models offline via llamafile and llama.cpp, cataloguing the OS-level failures encountered along the way. The writeup…