#265 · Primary category: Computer Vision

Cutie

computer-vision cvpr2024 deep-learning pytorch segmentation video-editing video-object-segmentation video-segmentation

[CVPR 2024 Highlight] Putting the Object Back Into Video Object Segmentation

Project last updated:11/08/24

GitHub Stars

1.1K

Forks

113

Contributors

8

License

MIT

Why we included this project

Cutie tracks a single object across a video clip once you supply the initial mask, which saves a lot of tedious frame-by-frame clicking. The scripting demo is the fastest way in: you hand it the first frame's mask, loop through the remaining frames in a plain PyTorch loop, and read back a per-object probability map at each step. That fits editing workflows like rotoscoping or pulling a subject out before compositing, and for people who would rather click than code, the bundled GUI also brings in the permanent memory option from XMem++ for tighter control over how objects are remembered. It's the follow-up to XMem with better consistency and speed, and the training and evaluation docs cover reproducing results on standard benchmarks if you're weighing segmentation models.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category