# Agentic video understanding in Gemini: Developer Guide

> Developer guide for on-demand, agentic video analysis in the Gemini API

This guide covers Google's agentic video understanding feature in the Gemini API, which replaces uniform 1 FPS frame sampling with a server-side tool loop. By inspecting transcripts first and pulling targeted frame slices or audio only when needed, it cuts token usage by up to 88% and reduces analysis costs on long videos.

Website: https://aistudio.google.com/learn/agentic-video-understanding-with-gemini

## What it is for

- Analyze long-form recordings like webinars, lectures, or earnings calls without paying to ingest every frame
- Pinpoint exact timestamps or fine-grained visual actions across lengthy footage
- Query public YouTube videos directly using natural language prompts

## Features

- Pass-by-reference video ingestion to minimize initial context consumption
- Iterative Think-Act-Observe tool loop for targeted inspection
- Transcript-first searching to answer questions before loading video frames
- Adaptive frame rate zooming (0.1 to 10 FPS) for specific time windows
- Mixed-mode support to pair static short clips with agentic long references
- Native support for YouTube URLs in API requests
- Compatible with Gemini 3.8 Flash, 3.7 Flash, and Flash-Lite models

## Pricing

Freemium. Guide is free; API usage billed per base Gemini token rates, with 50% discount via Batch API

## Details

- Type: Article or course
- Category: [AI](https://xiry.app/topics/ai.md)
- Open source: no
- Platforms: Web, API
- For: Developers and AI engineers building multimodal applications with video
- Alternative to: Uniform frame sampling video analysis, Twelve Labs
- Tags: gemini, video, google ai, llm, api, multimodal

## Why it was saved

- [@GoogleAIStudio, 1 September 2026](https://x.com/GoogleAIStudio/status/2094841307935957304): How to get started building with the new modality

## Related

- [Agentic Video in Gemini](https://xiry.app/resources/agentic-video-in-gemini): Dynamic video inspection for Gemini models that cuts token usage and cost (AI model, Paid)
- [Google AI Studio](https://xiry.app/resources/google-ai-studio): Web playground for prototyping and building Gemini-powered applications. (Web app, Freemium)
- [Google AI Studio Live](https://xiry.app/resources/google-ai-studio-live): Real-time multimodal voice and screen-sharing AI assistant powered by Gemini 2.0 (AI model, Freemium)
- [xAI API](https://xiry.app/resources/xai-api): Developer API for Grok models covering text, multimodal, voice, and vision (Web app, Paid)
- [Pixtral Large](https://xiry.app/resources/pixtral-large): Mistral AI's 124B parameter open-weights multimodal vision and language model (AI model, Freemium)
- [Cheaper Inference](https://xiry.app/resources/cheaper-inference): OpenAI-compatible API marketplace routing model requests at discounted rates (Web app, Paid)

Updated 10 October 2026. Page: https://xiry.app/resources/agentic-video-understanding-in-gemini-developer-guide

Make your own library: Xiry takes your saved reels, tweets, Reddit bookmarks and Watch Later videos, makes them searchable and pulls the useful stuff out, like this library. It's invite-only for now; join the waitlist at https://xiry.app/#waitlist.