{"slug": "provisioning-spec-for-air-gapped-host-isolated-local-llm-tooling", "title": "Provisioning Spec for Air-Gapped, Host-Isolated Local LLM Tooling", "summary": "A developer published an initial provisioning specification and compose templates on GitHub for running local LLMs, Open WebUI, and dev agents in isolated rootless containers with direct GPU acceleration. The specification targets a \"Zero-Pollution\" workflow using /dev/kfd and /dev/dri for bare-metal AMD/ROCm acceleration, loginctl enable-linger for persistent multi-container orchestration, and :Z SELinux boundaries, aimed at air-gapped and headless appliance setups on Fedora/RHEL. The prototype began around Distrobox but has evolved toward locked-down native OCI/Podman specifications.", "body_md": "Hi all,\n\nGot tired of seeing local LLM toolchains, agent dependencies, and scattered Python/Node environments pollute the host OS. Also wanted an architecture that doesn’t rely on cloud API black boxes or vendor-locked SaaS.\n\nI put together a provisioning specification focused on a strict “Zero-Pollution” workflow for running local LLMs, Open WebUI, and dev agents inside isolated rootless containers while maintaining direct GPU acceleration.\n\n`/dev/kfd` and `/dev/dri` for bare-metal AMD/ROCm acceleration without host-level driver breakage.`loginctl enable-linger`) for persistent, automated multi-container orchestration.`:Z`) boundaries.\nInitial prototype started around Distrobox, but has evolved toward fully locked-down native OCI/Podman specifications for air-gapped and headless appliance setups.\n\nPublished the initial specification and compose templates to GitHub:\n\nCurious to hear thoughts from anyone running isolated bare-metal AI workflows or hardening rootless container pipelines on Fedora/RHEL.", "url": "https://wpnews.pro/news/provisioning-spec-for-air-gapped-host-isolated-local-llm-tooling", "canonical_source": "https://forum.level1techs.com/t/provisioning-spec-for-air-gapped-host-isolated-local-llm-tooling/256313#post_1", "published_at": "2026-09-16 19:34:21+00:00", "updated_at": "2026-09-16 19:41:24.130943+00:00", "lang": "en", "topics": ["ai-tools", "ai-infrastructure", "large-language-models", "ai-agents", "developer-tools"], "entities": ["GitHub", "Open WebUI", "Distrobox", "Podman", "AMD", "ROCm", "Fedora", "RHEL"], "alternates": {"html": "https://wpnews.pro/news/provisioning-spec-for-air-gapped-host-isolated-local-llm-tooling", "markdown": "https://wpnews.pro/news/provisioning-spec-for-air-gapped-host-isolated-local-llm-tooling.md", "text": "https://wpnews.pro/news/provisioning-spec-for-air-gapped-host-isolated-local-llm-tooling.txt", "jsonld": "https://wpnews.pro/news/provisioning-spec-for-air-gapped-host-isolated-local-llm-tooling.jsonld"}}