IBM Granite

Meta released its 30B-parameter Muse Glimmer model under the Apache 2.0 license, a shift from the Llama Community License that removes restrictions on monthly active users, competition with Meta produ…

Xyntetik Runner, a GGUF model runtime written from scratch in plain C, is now available as a free Apache 2.0-licensed engine that serves, verifies, scores, adapts, and trains GGUF models deterministic…

IBM Research, Red Hat, and NxtGen Cloud Technologies demonstrated that using llm-d to serve AI models on mixed GPU hardware can boost inference speeds by 3 to 5 times and double throughput, enabling e…