Zml (auto-discovered)

ZML released ZML/LLMD, an inference server written in Zig that runs LLaMa, Gemma, Qwen, and Mistral LLMs on five architectures including NVIDIA CUDA, AMD ROCm, Google TPU, Intel oneAPI, and Apple Meta…