{"slug": "smaller-apps-and-faster-gpu-inference-with-litert-in-google-play-services", "title": "Smaller apps and faster GPU inference with LiteRT in Google Play services", "summary": "Google upgraded LiteRT in Google Play services with GPU inference that runs about 1.4x faster than the legacy GPU delegate, powered by ML Drift and exposed through the new CompiledModel API, the company said. Google reported that apps switching to LiteRT in Play services are about 8 MB smaller because the runtime and GPU accelerator ship once with Play services rather than inside each app, and it noted more than 100K Android apps currently bundle their own copy of LiteRT or TensorFlow Lite. Google deprecated the legacy GPU delegate and custom delegate APIs in favor of CompiledModel GPU acceleration and said NNAPI will be removed starting in 2027, while a new LiteRT skill for Android Studio Agent Mode automates migration.", "body_md": "LiteRT in Google Play services is Android's on-device inference runtime for custom models, handling more than a trillion inferences a day across billions of devices. Today, it gets its **biggest upgrade yet:** **GPU inference that runs about 1.4x faster than the legacy GPU delegate**, powered by [ML Drift](https://developers.googleblog.com/en/ml-drift-next-gen-gpu-aiml-inference-at-the-edge/) and available through the new [CompiledModel API](https://developers.googleblog.com/litert-maximum-performance-simplified/), LiteRT’s modern successor to the legacy Interpreter API.\n\nUntil now, taking advantage of this faster GPU stack required bundling LiteRT in your app. **In our testing, apps that switched to LiteRT in Google Play services are about 8 MB smaller**, **making them faster to download and lighter on users' devices**, because the runtime, including the GPU accelerator, ships once with Play services rather than inside every app. More than 100K Android apps bundle their own copy of LiteRT or TensorFlow Lite today, so the savings add up quickly as apps switch.\n\n**If your Android app runs custom ML models on CPU or GPU, we encourage you to switch to LiteRT in Google Play services.** You can see it in action in the [Google AI Edge Gallery](https://play.google.com/store/apps/details?id=com.google.ai.edge.gallery&hl=en_US) app, where the Scrapbook feature's image segmentation runs on LiteRT in Google Play services.\n\nDevelopers that adopt LiteRT in Google Play Services enjoy immediate benefits:\n\nLiteRT is the evolution of TensorFlow Lite. It keeps the same .tflite model format you rely on and adds the CompiledModel API, which makes acceleration across fragmented hardware reliable:\n\n`.tflite` model runs on Android, iOS, desktop, and web.\nWhether you're starting fresh or switching from bundled LiteRT, using LiteRT in Google Play services takes a [few lines of code](https://developers.google.com/edge/litert/android/play_services):\n\n`com.google.android.gms:play-services-litert:17.0.0` (or a later version). If you bundle LiteRT today, remove the `litert` dependency.`LiteRT` environment from Play services:\n\n```\nval liteRtEnvironment =\n    LiteRt.initialize(\n        context,\n        LiteRtDsl.initializationOptions { setEnableGpu(true) }\n    ).await()\n```\n\n`environment` in when you create your `CompiledModel`. The rest of your code stays the same.\n**If you're already using the legacy Interpreter API in Google Play services**, your Interpreter code keeps working on CPU when you switch to play-services-litert. To run on the GPU, move to the CompiledModel API.\n\n**Let your coding agent do the work.** In Agent Mode, the new LiteRT skill for Android Studio automates the move to LiteRT in Google Play services and the CompiledModel API. Ask it to “migrate my TFLite code to CompiledModel,” or type `@litert-runtime`, and it switches your app to play-services-litert, rewrites your Interpreter calls, and sets up GPU acceleration with CPU fallback. It can also scaffold a new LiteRT app. Treat it as a strong first pass: review the diff, build, and compare outputs on a real device. [Get the skill on GitHub](https://github.com/android/skills/tree/main/device-ai/litert/).\n\n**Upgrading from legacy APIs?** The legacy GPU delegate and custom delegate APIs are deprecated in favor of CompiledModel GPU acceleration and the [Compiler Plugin](https://developers.google.com/edge/litert/next/compiler_plugin) and [Dispatch](https://developers.google.com/edge/litert/next/dispatch) APIs, and NNAPI will be removed starting in 2027. Older SDKs now receive critical security fixes only. Apps you've already shipped keep working, but plan your move to the CompiledModel API now: code that uses deprecated APIs won't compile against the latest SDK, and staying on an older SDK can cause conflicts as your other dependencies move forward. See the [release notes](https://developers.google.com/android/guides/releases#october_28_2026) for details.\n\nLooking ahead, LiteRT in Google Play services is our foundation for running your own task-specific models on Android, with CPU and GPU acceleration.\n\nWe can't wait to see what you build.", "url": "https://wpnews.pro/news/smaller-apps-and-faster-gpu-inference-with-litert-in-google-play-services", "canonical_source": "https://developers.googleblog.com/smaller-apps-and-faster-gpu-inference-with-litert-in-google-play-services/", "published_at": "2026-10-28 20:42:33.106532+00:00", "updated_at": "2026-10-28 20:42:39.835336+00:00", "lang": "en", "topics": ["ai-tools", "developer-tools", "mlops", "ai-infrastructure"], "entities": ["Google", "LiteRT", "Google Play services", "ML Drift", "CompiledModel API", "TensorFlow Lite", "Android Studio", "NNAPI"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/smaller-apps-and-faster-gpu-inference-with-litert-in-google-play-services", "markdown": "https://wpnews.pro/news/smaller-apps-and-faster-gpu-inference-with-litert-in-google-play-services.md", "text": "https://wpnews.pro/news/smaller-apps-and-faster-gpu-inference-with-litert-in-google-play-services.txt", "jsonld": "https://wpnews.pro/news/smaller-apps-and-faster-gpu-inference-with-litert-in-google-play-services.jsonld"}}