AI · Web app

SAM 2

Promptable visual segmentation model for images and real-time video tracking.

Visit github.com ↗

Meta's Segment Anything Model 2 (SAM 2) is a computer vision foundation model that segments and tracks visual objects across images and video frames. Users can prompt the model with clicks or bounding boxes on a single frame, and it propagates masks throughout the entire video sequence in real time.

What it's for

  • Track and isolate moving objects across video frames without manual rotoscoping
  • Generate cutouts and green-screen masks for video editing and compositing
  • Blur or pixelate specific sensitive subjects across video footage
  • Segment multiple objects simultaneously in computer vision pipelines

Features

  • Zero-shot promptable segmentation via clicks, bounding boxes, or masks
  • Streaming memory architecture for real-time video tracking
  • Multi-object tracking support with independent per-object inference
  • Automatic mask generation across entire images
  • Pretrained checkpoints ranging from tiny to large
  • Official open-source web demo interface and backend code

Pricing

Open source. Free and open source under Apache 2.0

Details

Type
Web app
Category
AI
Topic
Computer Vision
Open source
Yes
Platforms
Web, Code library, Self-hosted, Linux, Windows
For
Video editors, AI researchers, and computer vision developers
Alternative to
Runway, Adobe After Effects Roto Brush
Tags
computer vision, segmentation, video editing, rotoscoping, object tracking, meta ai

Why it was saved

  • @mardan_king, 19 October 2024: Eliminates tedious manual rotoscoping by allowing users to isolate, blur, pixelate, or remove objects in video clips in seconds.

Compare

Related

  • Meta SAM 3

    Open-source vision model for zero-shot object segmentation and tracking in video

  • OpusClip

    AI tool that turns long videos into short social clips automatically.

  • Gling

    AI video editor that cuts bad takes, silences, and filler words

  • Meta Animated Drawings

    Turn static 2D character sketches into animated videos using AI.

  • quso.ai

    Turn long videos and podcasts into short, captioned social media clips

  • VEED.IO

    Browser-based video editor with automated AI trimming, subtitles, and eye tracking

Updated