#125 · Primary category: Computer Vision

RobustVideoMatting

ai computer-vision deep-learning machine-learning matting

Robust Video Matting in PyTorch, TensorFlow, TensorFlow.js, ONNX, CoreML!

Project last updated:04/02/24

GitHub Stars

9.5K

Forks

1.2K

Contributors

5

License

GPL-3.0

Why we included this project

Anyone doing video background replacement, virtual sets, or live-stream production knows how hard it is to cleanly separate a moving person from the frames behind them. Robust Video Matting handles this in real time with a recurrent network that carries temporal memory from one frame to the next, instead of treating each frame as an isolated image. That memory is the key: foreground boundaries stay stable across a clip, so you avoid the flicker and edge artifacts that per-frame matting tends to produce. You can pull a person's alpha mat and foreground from ordinary webcam or phone footage with no green screen, and pretrained weights for PyTorch, TensorFlow, ONNX, and CoreML let the same model run in browser, mobile, or server pipelines. With the bundled demos and inference docs, a small team can get a working matting solution rather than a research prototype.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category