#217 · Primary category: Video & Animation

V-Express

V-Express aims to generate a talking head video under the control of a reference image, an audio, and a sequence of V-Kps images.

Project last updated:01/24/25

GitHub Stars

2.4K

Forks

298

Contributors

4

License

Other

Why we included this project

V-Express is for teams that need talking-head video generation locally, from a single face photo and an audio clip. It produces a speaking video with lip movements that follow the speech, and it can also accept a pose-keypoint sequence from another clip to drive head motion. The key idea is a conditional-dropout training scheme that lets the audio signal remain effective alongside stronger pose and identity cues, which is the part many open-source talking-head models get wrong. The repo includes both inference and training code, plus memory optimizations for longer clips and a post-processing step that reduces flicker. If you are building dubbing, avatar, or synthetic-speaker pipelines, the provided scripts and the Hugging Face model card get you from install to a working example quickly.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category