llmman

Docker's sbx sandboxes can run Docker Agent in an isolated microVM while Zed connects to it over the ACP protocol, with llmman still serving the model on the host GPU, according to a hands-on write-up…

Eric Curtin's llmman, a Rust command-line tool billed as "Run any agent on any model," manages models as standard OCI Image Layouts pulled from Docker Hub, Hugging Face or private registries and serve…