#221 · Primary category: Video & Animation
AniPortrait
AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animation
Project last updated:07/02/24
GitHub Stars
5.0K
Forks
611
Contributors
2
License
Apache-2.0
Why we included this project
AniPortrait turns one photo of a face plus an audio clip into a talking-head video where the lip movements line up with the speech. You can also drive the animation from a video instead, copying the expressions and head motion of the source footage onto your reference image, which is useful when you already have recordings and want to reuse them rather than generate every gesture from scratch. The Gradio demo and documented inference commands make it easy to judge output quality before wiring it into a larger pipeline, whether your project is a virtual presenter, a game character, or localized voiceover content. It is research code from Tencent rather than a finished product: expect to download the pretrained weights yourself and keep an eye on GPU memory, but the workflow stays approachable for anyone comfortable with Python and diffusion models.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
yt-dlp
A feature-rich command-line audio/video downloader
MoneyPrinterTurbo
Generate HD short videos from a topic or keyword with an automated AI workflow.
Deep-Live-Cam
real time face swap and one-click video deepfake with only a single image
manim
Animation engine for explanatory math videos
anime
JavaScript animation engine