Agentic Video Understanding in Gemini

Google introduced agentic video understanding in Gemini, allowing the model to selectively inspect frames, audio, or transcripts, cutting token usage by up to 88%, lowering cost by up to 66%, and improving accuracy by up to 7%, now available via the Gemini API in AI Studio and Gemini Enterprise Agent Platform. Anthropic launched Claude Fable 5.1 and Mythos 5.1, cutting cache-read pricing by 75%, with Cursor adding Fable 5.1 and reporting a 73.4% score on CursorBench 3.2 at max effort. Other releases include World Labs' Atlas world model, Perplexity's Hybrid Compute, Shopify's open-sourced Tangle, and Alibaba's Qwen3.8-Max.

unwind ai ../ - Posts - Agentic Video Understanding in Gemini Agentic Video Understanding in Gemini + Claude Fable/Mythos 5.1 and Perplexity Hybrid Computer Start here ↓ Google just made long-video understanding agentic. Gemini’s new agentic video understanding lets the Gemini model decide what parts of a video to inspect through frames, audio, or transcripts. That is very different from sampling a video at a fixed FPS and hoping the important moment made it into context. It means the model can skim, search, zoom in, rewatch, and pull evidence only when the question needs it. This feature cuts token usage by up to 88%, lowers cost by up to 66%, and improves accuracy by up to 7%. Now available through the Gemini API in AI Studio and Gemini Enterprise Agent Platform. 🚀 Shipped Anthropic launched Claude Fable 5.1 and Mythos 5.1. Fable 5.1 is the generally available model for coding and knowledge work, while Mythos 5.1 is the restricted version for trusted cybersecurity and life-sciences programs. Anthropic is also cutting cache-read pricing by 75%, which matters for long agent runs that keep reusing the same repo, docs, and tool context. Cursor already added Fable 5.1 and says it is their strongest model on CursorBench 3.2, scoring 73.4% at max effort. Claude Fable 5.1 and Mythos 5.1 https://www.anthropic.com/claude-fable-and-mythos-5-1?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini | Cursor announcement https://x.com/cursor ai/status/2094852929282879596?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini Dr. Fei-Fei Li’s World Labs introduced Atlas, a world model that cares about camera control . Atlas works across text, images, video, and 3D, and can generate video with precise camera paths instead of vague “pan left” prompting. It can also reconstruct scenes from sparse images or video into point clouds and Gaussian splats, which is the part to watch for robotics, VFX, and game tooling. Atlas by World Labs https://www.worldlabs.ai/blog/atlas?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini Perplexity’s Hybrid Compute is a great application of “local when it matters, cloud when it helps.” Hybrid Compute lets the app split a task between cloud models and a local model on your Mac. Web research can go to the cloud, but private files, app steps, and PII-heavy work can stay on-device, with an open-sourced classifier deciding what leaves the machine. Perplexity Hybrid Compute https://www.perplexity.ai/hub/products/hybrid-compute?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini Shopify open-sourced Tangle for building ML pipelines visually. It gives teams a drag-and-drop editor for experiments, reusable pipeline components, collaborative runs, and caching so repeated steps don’t waste compute. The nice part: it makes the loop inspectable, so agents are not just “trying stuff” in a chat window. Tangle https://tangleml.com/?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini Alibaba refreshed Qwen3.8-Max for bigger coding and agent runs . qwen3.8-max-0902 is a 2.4T-parameter model with a 1M-token context window, stronger coding/cowork post-training, and better tool orchestration for long-horizon projects. It is live on QwenCloud at $2/M input and $6/M output tokens, with cheaper cache reads. Qwen3.8-Max-0902 https://www.qwencloud.com/models/qwen3.8-max-0902?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini GojiberryAI open-sourced a Sales OS for Grok Bot . It turns Grok into a 13-agent outbound team for finding intent signals, checking ICP fit, researching accounts, drafting LinkedIn messages, handling replies, and qualifying meetings. It can run autonomously, but starts in “show me the list before anyone is contacted” mode, which is exactly where sales agents should start. GojiberryAI Sales OS https://github.com/romangojiberryAI/gojiberryai-sales-os?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini GitHub CLI can now attach screenshots and videos without opening GitHub . Their latest release adds a repeatable --attach flag for issues, PRs, and comments. This is a small CLI change that fixes a very real agent annoyance: stop describing the broken UI, attach the screenshot. GitHub CLI media in issues, pull requests, and comments https://github.blog/changelog/2026-09-01-github-cli-media-in-issues-pull-requests-and-comments/?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini Reducto shipped r-1, a cheaper parser for ugly documents. The new model is built for the stuff that breaks other OCRs like dense tables, strikethroughs, watermarks, citations, and weird visual layouts. Reducto says r-1 preview cuts error rate 20% versus its legacy agentic OCR models and costs 1 cent per page. Introducing r-1 https://reducto.ai/blog/parse-r-1-model?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini Hermes Agent v0.21.0 is basically agent society plumbing. The Pantheon release adds bot-to-bot DMs across profiles and gateways, cron jobs with continuity and monitor-mode suppression, live steering for delegated subagents, JSON schema validation, and a much better MCP command center. If you are running multiple agents already, this is the release where handoffs start feeling less like duct tape. Hermes Agent v0.21.0 https://github.com/NousResearch/hermes-agent/releases/tag/v2026.8.31?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini OpenClaw 2.0 is incredibly easy to use. Cleaner setup that can reuse your existing ChatGPT/Claude/API/local model access, and a rebuilt browser app that opens straight into a working agent workspace. Other interesting things include shared cloud sessions, so someone else can join or take over live agent work without losing the context. A lot of other QoL updates OpenClaw 2.0, Accidentally https://openclaw.ai/blog/openclaw-2-accidentally?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini 🧠 Worth Knowing This is one of the best agentic engineering setups you’ll read today for working with multiple coding agents. David Ondrej is running agents across bb, cmux, Ghostty, Herdr, VPS boxes, and subscription plans, then prioritizing finished work with Corral. You probably do not need the whole stack, but if your current workflow is “check five agent windows randomly,” this is worth skimming. David Ondrej’s agentic engineering setup https://x.com/DavidOndrej1/status/2094424967345496191?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini Poteto published the workflow stack she uses to keep Grok Bot coding runs from turning into slop . Lauren Tan works on Grok Bot, and her pstack plugin for Grok Bot gives your agents reusable skills for verification, feature maps, playbooks, and multi-model review. If you are trying to run more coding agents without drowning in sloppy diffs, this is worth checking. pstack for Grok Bot https://x.ai/bot/plugin/9717366?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini | pstack repo https://github.com/cursor/plugins/tree/main/pstack?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini A new paper takes aim at the laziest safety phrase: “human in the loop.” Researchers argue that human oversight is not a checkbox, especially when agents hide intermediate steps, produce too much to review, and slowly train users to stop checking. AI Agents Push Humans Out of the Loop https://arxiv.org/abs/2608.23642?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini Simon Willison wrote the missing manual for ChatGPT Work. According to him “it's a deeply confusing but extremely powerful tool with a whole lot of useful features that aren't available in regular ChatGPT” Understanding ChatGPT Work https://simonwillison.net/2026/Aug/30/understanding-chatgpt-work/?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini TinyFish gave DeepSeek Harness free Search and Fetch . Install the TinyFish CLI and DSH picks it up automatically, which means agents can search the web and fetch clean page text for free when stale context is not enough. TinyFish announcement https://x.com/Tiny Fish/status/2094838868499714441?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini | TinyFish CLI https://docs.tinyfish.ai/cli?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini 🔧 Clone and Run Clone & Run of the Day Diffusion Studio is an open-source video editor built for agents . The simplest way to think about it: an IDE, but it renders a video canvas instead of text. Every edit is code, so an agent can cut, tweak, and reuse video edits without handing you one frozen MP4. Diffusion Studio Editor https://github.com/diffusionstudio/editor?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini Obscura is a headless browser for agents . It gives agents a browser they can drive through CLI or MCP, with tools for clicks, forms, screenshots, PDFs, JavaScript, network logs, and scraping. Worth trying if your agent keeps getting stuck on websites that plain fetch cannot handle. Obscura https://github.com/h4ckf0r0day/obscura?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini Rakazo is an open-source Grok Bot-style app . You get persistent AI teammates with their own memory, routines, browser, terminal, files, and computer access. You can bring your own models and run the stack yourself instead of depending on one hosted agent app. Rakazo https://github.com/elie222/rakazo?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini ECC is a giant repo of agent skills, configs, and workflows . It has setup files for Claude Code, Codex, OpenCode, Cursor, Gemini, Hermes, Qwen, and more. Would treat it as an awesome reference library first, not something to drop blindly into a real repo. ECC https://github.com/affaan-m/ECC?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini headcount turns Claude Code into an agent org chart . Instead of one giant coding agent, it gives you departments like engineering, security, finance, legal, growth, and support, each with its own skills. headcount https://github.com/cbrock84/headcount?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini VoiceStudio is a local-first ElevenLabs alternative. It runs voice cloning, dubbing, dictation, transcription, and audiobook workflows across Mac, Windows, and Linux. No account or API key needed for the core workflow VoiceStudio https://github.com/debpalash/VoiceStudio?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini Awesome LLM Apps https://github.com/Shubhamsaboo/awesome-llm-apps?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini is a curated collection of 100+ AI Agents, Agent skills, and RAG apps. It covers models from OpenAI, Anthropic, Google, and open-source models like GLM, DeepSeek, and Qwen that you can run locally on your computer. Now accepting GitHub sponsorships https://sponsorunwindai.com/?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini 📊 By the Number Number of the Day Together AI cut dedicated H100 inference from $5.49/hr to $3.99/hr for September. The discount applies automatically to new and existingdedicated inference deployments, so teams already running H100 endpoints get the lower bill without moving anything. Together AI announcement https://x.com/togethercompute/status/2094583517015376237?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini A 2B model was trained from Qwen2-1.5B on a single RTX 5090 inside a $5,090 budget . Puro-2B is an open recipe for small-model pretraining on consumer GPUs, with data, code, and weights released under Apache 2.0. The caveat is that the budget and Qwen2-1.5B comparison come from the paper’s own evaluation setup. Puro-2B paper https://huggingface.co/papers/2608.27370?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini Someone benchmarked Qwen3.8-Flash-Next across the whole local hardware ladder. In llama.cpp, the model goes from 8.34 tok/s on CPU-only to 109.07 tok/s on a 96GB VRAM setup. The ceiling comes from an RTX 6000 PRO-class card, so this is a hardware map, not a casual laptop win. Qwen3.8-Flash-Next llama.cpp thread https://www.reddit.com/r/LocalLLaMA/comments/1w3pl64/qwen38flashnext in llamacpp from cpuonly to 96gb/?utm source=www.theunwindai.com&utm medium=referral&utm campaign=agentic-video-understanding-in-gemini That's all for today. Come back tomorrow for the next batch of AI tools, model drops, agent repos, and weird benchmarks worth your time. If you found one thing to try, share the issue with someone who ships. Cut Lead Review From Hours To Minutes Sign up for a free trial of Attio https://attio.com/?utm source=beehiiv&utm medium=newsletter sponsorship&utm campaign=beehiiv-Y26&utm content=JHL0VVEUDT& bhiiv=opp eee8741e-0d90-4013-8d3c-3f8f9806ea99 7395cee5&bhcl id=5ecb84a9-4646-431a-8184-c70fed9729e8 SUBSCRIBER ID {{email address id}} , the agentic CRM. Ask Attio to build a daily workflow that surfaces the deals that need your attention today, like anything with a stage change, a recent reply, or a new signal in the last 24 hours. Review your pipeline in Claude, synced live from Attio via MCP. That's it.