Google announced LiteRT.js, a JavaScript binding of its LiteRT inference library that enables high-performance AI model execution directly in web browsers via WebAssembly. The tool supports hardware a…
Google released LiteRT-LM, a new runtime framework that accelerates on-device inference for its Gemma 4 large language models by up to 2.2x using multi-token prediction. The framework, built on the Li…
The W3C draft specification WebNN defines a graph-based neural network API that enables JavaScript to submit static model graphs to native OS runtimes, according to a November 21, 2025 blog post on zi…
Arm's Scalable Matrix Extension 2 (SME2) integrates a matrix-compute unit into the CPU, enabling up to 5x faster inference for generative AI workloads on mobile devices. It highlights how Google AI Ed…