# Agentic Video in Gemini

> Dynamic video inspection for Gemini models that cuts token usage and cost

Agentic video understanding is a Gemini API capability that lets models dynamically search, scan, and inspect target video segments instead of ingesting full videos at a static frame rate. It cuts token consumption by up to 88% and lowers processing costs by up to 66% while improving accuracy on long-form video tasks. Available across Gemini models like 3.7 Flash, it supports both direct video uploads and YouTube URLs.

Website: https://blog.google/innovation-and-ai/models-and-research/gemini-models/introducing-agentic-video-in-gemini

## What it is for

- Search multi-hour lectures and keynotes for specific moments or details without blowing token budgets
- Pinpoint sub-second cut boundaries and state changes for automated video editing
- Count repetitive physical actions or track specific objects across video footage
- Detect subtle visual anomalies by dynamically resampling candidate time windows at higher frame rates

## Features

- Dynamic scrubbing across visual frames, audio, and transcripts
- Support for multi-hour video uploads and YouTube links
- Internal tool invocation within an agentic reasoning loop to load specific clips
- Up to 88% reduction in token consumption compared to standard 1 FPS static processing
- Up to 66% reduction in query costs
- Configurable via Google AI Studio and the Gemini Enterprise Agent Platform API

## Pricing

Paid. Billed via Gemini API token usage in Google AI Studio and Gemini Enterprise Agent Platform

## Details

- Type: AI model
- Category: [AI](https://xiry.app/topics/ai.md)
- Open source: no
- Platforms: API, Web
- For: Developers and AI engineers building search, indexing, or editing tools for long-form video
- Alternative to: Twelve Labs, Static Gemini video prompting
- Tags: gemini, video understanding, multimodal, deepmind, api, video search

## Why it was saved

- [@vamsibatchuk, 1 September 2026](https://x.com/vamsibatchuk/status/2094841911001469304): Long-video Q&A at a fraction of the token cost; a practical building block for search-over-video apps.

## Related

- [Agentic video understanding in Gemini: Developer Guide](https://xiry.app/resources/agentic-video-understanding-in-gemini-developer-guide): Developer guide for on-demand, agentic video analysis in the Gemini API (Article or course, Freemium)
- [Gemini Omni](https://xiry.app/resources/gemini-omni): Conversational multimodal AI model for step-by-step video editing and generation (AI model, Freemium)
- [Google AI Studio](https://xiry.app/resources/google-ai-studio): Web playground for prototyping and building Gemini-powered applications. (Web app, Freemium)
- [Google AI Studio Live](https://xiry.app/resources/google-ai-studio-live): Real-time multimodal voice and screen-sharing AI assistant powered by Gemini 2.0 (AI model, Freemium)
- [PDF to Structured Data](https://xiry.app/resources/pdf-to-structured-data): Extract structured JSON from PDFs using natural language instructions and Gemini (Web app, Free)
- [xAI API](https://xiry.app/resources/xai-api): Developer API for Grok models covering text, multimodal, voice, and vision (Web app, Paid)

Updated 10 October 2026. Page: https://xiry.app/resources/agentic-video-in-gemini

Make your own library: Xiry takes your saved reels, tweets, Reddit bookmarks and Watch Later videos, makes them searchable and pulls the useful stuff out, like this library. It's invite-only for now; join the waitlist at https://xiry.app/#waitlist.
