# Goku

> Rectified flow foundation models for joint image and video generation

Goku is a family of visual foundation models developed by researchers from ByteDance and HKU, using rectified flow Transformers. It handles text-to-video, image-to-video, and text-to-image generation with top benchmark scores on VBench and GenEval.

Website: https://github.com/saiyan-world/goku

## What it is for

- Generate dynamic video sequences directly from descriptive text prompts
- Animate still images into continuous video clips
- Create photorealistic images from textual descriptions

## Features

- Rectified flow Transformer architecture for joint image and video generation
- Text-to-video (T2V) generation with high motion smoothness and dynamic degree
- Image-to-video (I2V) capabilities
- Text-to-image (T2I) synthesis
- Top-ranking VBench score of 84.85 among competitive video models
- Carefully curated fine-grained image and video training data

## Pricing

Open source. Free and open research project

## Details

- Type: AI model
- Category: [AI](https://xiry.app/topics/ai.md)
- Topic: [AI Video Generation](https://xiry.app/topics/ai/ai-video-generation.md)
- Open source: yes
- Platforms: Self-hosted, Code library
- For: AI researchers, machine learning engineers, and video generation developers
- Alternative to: Runway Gen-3, Luma Dream Machine, Kling AI, CogVideoX, HunyuanVideo
- Tags: video generation, text to video, image to video, bytedance, flow matching, diffusion

## Why it was saved

- [@EHuanglu, 11 February 2025](https://x.com/EHuanglu/status/1889321582226767902): A free/open model covering video + voice + avatar lipsync in one, announced as a rival option for AI video generation.

## Compare

- [Alternatives to Luma Dream Machine](https://xiry.app/alternatives/luma-dream-machine.md)
- [Alternatives to Kling AI](https://xiry.app/alternatives/kling-ai.md)
- [Alternatives to Runway](https://xiry.app/alternatives/runway.md)

## Related

- [Runway](https://xiry.app/resources/runway): AI creative suite for generating and editing video, images, and animation (Web app, Freemium)
- [Pika](https://xiry.app/resources/pika): AI platform generating and editing video, image, and synchronized audio. (Web app, Freemium)
- [Hailuo AI](https://xiry.app/resources/hailuo-ai): AI video and image generator known for cinematic motion and physics (AI model, Freemium)
- [invideo](https://xiry.app/resources/invideo): AI-assisted multitrack video editor and text-to-video generator for creators and teams. (Web app, Freemium)
- [Kling AI](https://xiry.app/resources/kling-ai): AI video and image generator with advanced motion control and physical simulation (Web app, Freemium)
- [Google DeepMind Veo](https://xiry.app/resources/google-deepmind-veo): Generative AI video model producing cinematic footage with native audio (AI model, Freemium)

Updated 10 October 2026. Page: https://xiry.app/resources/goku

Make your own library: Xiry takes your saved reels, tweets, Reddit bookmarks and Watch Later videos, makes them searchable and pulls the useful stuff out, like this library. It's invite-only for now; join the waitlist at https://xiry.app/#waitlist.