#277 · Primary category: Video & Animation

talking-head-anime-2-demo

ai anime computer-graphics computer-vision deep-learning machine-learning python pytorch vtuber

Demo programs for the Talking Head Anime from a Single Image 2: More Expressive project.

Project last updated:06/29/22

GitHub Stars

1.2K

Forks

150

Contributors

4

License

MIT

Why we included this project

Anime creators and VTuber hobbyists who want to see whether a single still illustration can drive a live, expressive face will find a working answer here. The repo ships two programs: a manual poser that adjusts a character's facial expression and head rotation through sliders, and a puppeteer tool that pipes facial motion captured by the iFacialMocap app on an iPhone's TrueDepth camera onto the same image. That second route is the more interesting one for people prototyping cheap virtual avatars, since it covers the full chain from blend-shape capture to rendered animation. Everything is Python 3 and PyTorch, and a Google Colab notebook lets you try the poser without a powerful Nvidia GPU on hand. Plan on a recent high-end card, supply your own model files from Dropbox, and treat it as a research-grade starting point rather than a finished product.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category