Google AI Edge Gallery launches on macOS, letting Mac users run Gemini models locally

Google launched Google AI Edge Gallery for macOS, allowing Mac users to run Gemma models locally on their devices. The company also released the Gemma 4 12B model, a multimodal AI with 12 billion parameters designed for local agentic tasks, and introduced the Google AI Edge Eloquent dictation app for Mac. These releases expand Google's local AI ecosystem, offering users privacy and offline capabilities while running AI models directly on their computers.

In addition to Google AI Edge Gallery, which lets users run Gemma models locally on their Macs, the company also released the Gemma 4 12B model and the Google AI Edge Eloquent dictation app for the Mac. Here are the details. A bit of background The majority of users who rely on LLMs for everyday tasks tend to use ChatGPT, Claude, or Gemini, which are cloud-based models running on OpenAI, Anthropic, and Google’s servers. Another way to interact with LLMs is through local models. These are usually much smaller and less capable than the trillion-parameter models that run in the cloud, but they also come with several advantages. For one, being less capable than cloud-based models does not mean they are bad . Also, they do not require an active internet connection, since they run on the computer’s own processing power. Additionally, the better the computer, the faster the responses, and the larger the models it can handle. And finally, because everything runs locally, these models are more private too, since conversation data does not need to leave the device. There are a few ways to install local models on a Mac, and we covered this here https://9to5mac.com/2025/08/06/how-to-run-gpt-oss-20b-on-mac/ , when OpenAI released its own open models. But in a nutshell, you need to install platforms such as Ollama https://ollama.com and LM Studio https://lmstudio.ai , and then install a model that can runs smoothly on your Mac’s hardware. Hugging Face https://huggingface.co hosts thousands of open models to choose from, including those from frontier labs. However, platforms such as Ollama and LM Studio also offer ways to install these models directly from them. Which brings us to Google AI Edge Gallery https://developers.google.com/edge/gallery , Google’s platform for running AI models locally. Google already offered a Google AI Edge Gallery app for Android and for iOS, but today the company released it for macOS as well. Google AI Edge Gallery and Gemma 4 12B One thing to note right from the get-go is that, contrary to Ollama and LM Studio, which allow users to install any AI model compatible with their hardware, Google AI Edge Gallery for Mac currently only offers access to 5 of Google’s own models, where ‘it’ stands for instruct, meaning they can be tuned to follow user instructions rather than simply complete text: - Gemma-4-12B-it - Gemma-4-E2B-it - Gemma-4-E4B-it - Gemma-3n-E2B-it - Gemma-3n-E4B-it The top item on the list is particularly notable. Gemma 4 12B https://blog.google/innovation-and-ai/technology/developers-tools/introducing-gemma-4-12B/ was released today, and it was designed to bring agentic, multimodal intelligence directly to your laptop,” according to Google. While most consumer-facing local models from frontier AI labs tend to stay somewhere between 2 billion and 9 billion parameters, Google says Gemma 4’s 12-billion-parameter design delivers performance comparable to its 26-billion-parameter mixture-of-experts model, while still being “small enough to run locally on consumer laptops with 16GB of RAM.” Gemma 4 12B is also multimodal, which means it can handle text, vision, and audio. Google says that the model also packs good coding capabilities, “allowing you to extract meaningful insights from your data right on your device.” You can learn more about Google AI Edge Gallery here https://developers.googleblog.com/bringing-gemma-4-12b-to-your-laptop-unlocking-local-agentic-workflows-with-google-ai-edge/ , and you can learn more about Gemma 4 12B here https://blog.google/innovation-and-ai/technology/developers-tools/introducing-gemma-4-12B/ . Google AI Edge Eloquent Alongside Gemma 12B and the release of Google AI Edge Gallery for macOS, Google also launched the Google AI Edge Eloquent https://developers.google.com/edge/eloquent app for Mac today, after bringing the app to iOS a few months ago. Google AI Edge Eloquent is a free dictation app that captures what users say and transcribes it while polishing the text, removing disfluencies, and making light edits for clarity and flow. Processing is done on-device, rather than on the cloud. The app also lets users choose between different writing styles and add custom words, such as names, jargon, and other terms they use often. That helps avoid the kind of frequent miscorrections that dictation apps can otherwise make with specific words and phrases. You can learn more about Google AI Edge eloquent here https://developers.google.com/edge/eloquent . Worth checking out on Amazon David Pogue – ’Apple: The First 50 Years’ https://amzn.to/46Y3nQj MacBook Neo https://amzn.to/47vJmkn Logitech MX Master 4 https://amzn.to/3KmIQN7 AirPods Pro 3 https://www.amazon.com/Apple-Cancellation-Translation-Headphones-High-Fidelity/dp/B0FQFB8FMG?tag=marcmendes-20 AirTag 2nd Generation – 4 Pack https://amzn.to/4sewc3a Apple Watch Series 11 https://amzn.to/46VomDB Wireless CarPlay adapter https://www.amazon.com/gp/product/B0F6T6N2B1?tag=marcmendes-20 FTC: We use income earning auto affiliate links. More. https://9to5mac.com/about/ affiliate our homepage http://9to5mac.com/ for all the latest news, and follow 9to5Mac on exclusive stories https://9to5mac.com/feature/exclusive/ , reviews https://9to5mac.com/guides/review/ , how-tos https://9to5mac.com/guides/how-to/ , and subscribe to our YouTube channel https://www.youtube.com/9to5mac