At MLSys 2026, Modular identified three key trends in AI inference, highlighted by keynotes on agentic kernel development and the need for "zero trust" verification to prevent benchmark cheating. Lido…
Modular has built a new data layer for LLM inference routing that solves the problem of querying cached blocks across hundreds of pods in microseconds. The company's architecture uses a specialized da…
A developer built a production pastebin service called mobin using only the Mojo programming language, creating 10 supporting libraries and a documentation tool from scratch in a few weeks with AI cod…
Hippocratic AI partnered with Modular to integrate the MAX framework into its inference pipelines, achieving sub-500ms mean time to first token and approximately 30% faster P99 end-to-end latency for …
Modular released AI agent skills for its Mojo language that enable coding assistants to translate existing GPU kernels from CUDA and Triton into Mojo code, addressing the challenge that large language…
Modular CEO and Google AI infrastructure veteran Chris Lattner launched Inkwell, a real-time illustrated storybook app built on the company's Modular Cloud inference platform, demonstrating sub-second…
Modular announced that traditional HTTP-era load balancing algorithms like round-robin, consistent hashing, and least-connections are inadequate for large language model inference because GPU pods are…
Modular hosted an AMD AI DevDay event and opened new offices, while its community continued to ship new projects and contributions. The company's latest Modverse update highlights ongoing collaboratio…