Show HN: Shard – Distributed AI Inference Across Multiple Computers An open-source project called SHARD (shard-engine) released a distributed local LLM inference engine that pools GPU VRAM and system RAM across LAN machines to run 14B, 32B, and 70B+ open-weight models that no single card can hold. SHARD, written in Python with FastAPI and PyTorch on a GGUF/llama.cpp backend plus native C++20/MASM AVX2 SIMD kernels, uses UDP discovery on port 8001 and FastAPI SSE endpoints on port 8000, and exposes OpenAI-compatible (/v1/chat/completions, /v1/completions, /v1/models) and Anthropic-compatible (/v1/messages) endpoints so coding agents such as Cursor, Claude Code, Aider, Continue, Zed, and OpenCode can connect. The project also ships a `shard fit` command that checks whether a Hugging Face model will fit a single GPU, a hybrid CPU+GPU setup, or a pooled LAN cluster before weights are downloaded. English | Русская версия https://github.com/avelone123123/shard/blob/master/README.ru.md | Қазақша нұсқасы https://github.com/avelone123123/shard/blob/master/README.kz.md One Network. Many Servers. Shared AI Infrastructure.