{"slug": "google-launches-agentic-video-understanding-for-gemini-flash-models-cutting-by", "title": "Google Launches Agentic Video Understanding for Gemini Flash Models, Cutting Video Tokens by Up to 88%", "summary": "Google launched agentic video understanding for its Gemini Flash models, enabling the AI to navigate video timelines instead of ingesting them at a fixed 1 frame per second, and reports up to 88% fewer tokens, up to 66% lower cost, and up to 7% higher accuracy on standard video benchmarks. The feature is available as a hosted API through the Gemini API in Google AI Studio and the Gemini Enterprise Agent Platform, supporting Gemini 3.8, 3.7, 3.6 Flash and 3.5 Flash-Lite, with standard API pricing and no additional feature fee.", "body_md": "Video has been the most expensive modality to reason over. A Gemini model handed a 90-minute lecture has, until now, ingested the whole thing at a fixed one frame per second, whether the question was ‘summarize this’ or ‘what time does the speaker switch to the pricing slide?’ That single-pass design forces a bad trade: pay for the full timeline in context, or pre-chunk the video and risk dropping the detail that mattered.\n\nThis week, Google [launched agentic video understanding](https://blog.google/innovation-and-ai/models-and-research/gemini-models/introducing-agentic-video-in-gemini/) across its Flash models. Instead of ingesting the timeline, Gemini navigates it deciding what to watch, at what frame rate, and through which modality. Google reports up to 88% fewer tokens, up to 66% lower cost, and up to 7% higher accuracy on standard video benchmarks.\n\n**Is it deployable?** Yes, but only as a hosted API feature. There are no open weights and nothing to self-host. It ships through the [Gemini API](https://ai.google.dev/gemini-api/docs/video-understanding#agentic-video-understanding) in Google AI Studio and the [Gemini Enterprise Agent Platform](https://docs.cloud.google.com/gemini-enterprise-agent-platform/models/capabilities/video-understanding), works with both file uploads and public YouTube URLs, and bills at standard Gemini API token pricing with no additional feature fee.\n\n## **What actually changed**\n\nStatic processing, still the default on every Gemini model, extracts frames at 1 FPS in a single pass, processes audio at 1 Kbps single channel, and inserts timestamps every second. Agentic processing replaces that with a loop. The model pairs its own reasoning with native video tools to search, scan, and inspect target segments across frames, audio, and transcripts, loading only what the prompt requires. Developers could already assemble this by hand; the change is that Gemini runs the loop internally, which is where the development overhead disappears.\n\nAcross Google’s evaluations, Gemini 3.7 Flash with agentic understanding lands on the accuracy-to-cost Pareto frontier for video analysis among the models tested. The efficiency gains concentrate on long-form content, from 10-minute how-to guides to multi-hour recordings.\n\n## **What the API returns**\n\nAgentic processing adds two step types to the response `steps` array: a `processing_call` when the model requests a segment or transcript, and a matching `processing_result` when that load completes. They interleave with `thought` steps and precede `model_output`, so they can drive a live progress trace in your UI. Their presence is also how you verify agentic mode actually ran.\n\nToken accounting splits accordingly. Navigation reasoning bills as thought tokens (`total_thought_tokens`); frames, audio, and transcripts loaded on demand bill as tool-use tokens (`total_tool_use_tokens`).\n\nEnabling it is one field on the video part:\n\n```\ninteraction = client.interactions.create(\n    model=\"gemini-3.7-flash\",\n    input=[\n        {\n            \"type\": \"video\",\n            \"uri\": \"https://youtu.be/7Z5Vy9JBANs\",\n            \"processing\": \"agentic\"\n        },\n        {\n            \"type\": \"text\",\n            \"text\": \"What are the 3 most important announcements in this keynote?\",\n        },\n    ],\n)\n```\n\nYou can also mix modes per video inside a single request, agentic on the long lecture, static on the short clip.\n\n## **Key Takeaways**\n\n- Agentic mode lets Gemini navigate a video timeline instead of ingesting it at a fixed 1 FPS.\n- Google reports up to 88% fewer tokens, 66% lower cost, and 7% higher accuracy on video benchmarks.\n- Supported on Gemini 3.8, 3.7, 3.6 Flash and 3.5 Flash-Lite; enabled by one `processing` field.\n- Static remains better for clips under five minutes and for frame-by-frame precision work.\n- Standard API pricing applies, but navigation reasoning is billed as thought tokens.\n\nCheck out the [Google blog](https://blog.google/innovation-and-ai/models-and-research/gemini-models/introducing-agentic-video-in-gemini/), [Gemini API video understanding docs](https://ai.google.dev/gemini-api/docs/video-understanding), [Developer guide in AI Studio](https://aistudio.google.com/learn/agentic-video-understanding-with-gemini) and [Agentic vision announcement](https://blog.google/innovation-and-ai/technology/developers-tools/agentic-vision-gemini-3-flash/). Also, feel free to follow us on **[Twitter](https://x.com/intent/follow?screen_name=marktechpost)** and don’t forget to join our **[150k+ML SubReddit](https://www.reddit.com/r/machinelearningnews/)** and Subscribe to **[our Newsletter](https://magic.beehiiv.com/v1/f5e63dd4-5653-4f09-83e2-321a8b1ba526?email={{email}})**. Wait! are you on telegram? [now you can join us on telegram as well.](https://t.me/machinelearningresearchnews)\n\nNeed to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.? [Connect with us](https://forms.gle/wbash1wF6efRj8G58)\n\nMichal Sutter is a data science professional with a Master of Science in Data Science from the University of Padova. With a solid foundation in statistical analysis, machine learning, and data engineering, Michal excels at transforming complex datasets into actionable insights.", "url": "https://wpnews.pro/news/google-launches-agentic-video-understanding-for-gemini-flash-models-cutting-by", "canonical_source": "https://www.marktechpost.com/2026/09/04/google-agentic-video-understanding-gemini-flash-models/", "published_at": "2026-09-05 04:37:25+00:00", "updated_at": "2026-09-07 05:26:31.011351+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-products", "ai-tools"], "entities": ["Google", "Gemini API", "Google AI Studio", "Gemini Enterprise Agent Platform", "Gemini 3.8 Flash", "Gemini 3.7 Flash", "Gemini 3.6 Flash", "Gemini 3.5 Flash-Lite"], "alternates": {"html": "https://wpnews.pro/news/google-launches-agentic-video-understanding-for-gemini-flash-models-cutting-by", "markdown": "https://wpnews.pro/news/google-launches-agentic-video-understanding-for-gemini-flash-models-cutting-by.md", "text": "https://wpnews.pro/news/google-launches-agentic-video-understanding-for-gemini-flash-models-cutting-by.txt", "jsonld": "https://wpnews.pro/news/google-launches-agentic-video-understanding-for-gemini-flash-models-cutting-by.jsonld"}}