#259 · Primary category: Video & Animation

StableVideo

aigc computer-vision controlnet diffusion-model video-editing

[ICCV 2023] StableVideo: Text-driven Consistency-aware Diffusion Video Editing

Project last updated:09/07/23

GitHub Stars

1.4K

Forks

87

Contributors

2

License

Apache-2.0

Why we included this project

StableVideo is a research implementation for changing what appears in an existing video, such as repainting an object, recoloring a car, or altering a scene. It edits a layered representation of the footage once and propagates that change across frames, which keeps the result temporally consistent instead of flickering or drifting between shots. That makes it a useful reference for researchers reproducing the ICCV 2023 paper, and for developers curious whether prompt-driven video editing can fit their own pipelines. The repo includes a Gradio app, a CPU-only variant, and detailed VRAM tables, so you can estimate the memory cost before committing hardware. Expect a research-grade setup: you will need pretrained ControlNet weights and example video atlases, and the default float32 configuration wants about 29 GB of VRAM, though the amp and CPU-cache flags can cut that nearly in half.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category