#261 · Primary category: Video & Animation

talking-head-anime-3-demo

ai anime computer-graphics computer-vision machine-learning python pytorch vtuber

Demo Programs for the "Talking Head(?) Anime from a Single Image 3: Now the Body Too" Project

Project last updated:08/29/23

GitHub Stars

1.0K

Forks

107

Contributors

4

License

MIT

Why we included this project

Animate an anime character from a single still image: that is the whole pitch of this project, and it delivers it as two runnable demo programs. One is a manual poser that lets you twist the head, rotate the body, adjust facial expression, and raise the chest with breathing motion through a GUI. The other, ifacialmocap_puppeteer, captures your own face on an iPhone and maps the motion onto the character, which is where the VTuber appeal comes in. Both are desktop apps written in Python and expect a recent Nvidia GPU, though the manual poser can also be tried in a Google Colab notebook if you do not have the hardware. Real-time face puppeteering additionally needs an iOS device with a TrueDepth camera, such as an iPhone X or newer. The code is research-grade demo material, so budget for reading source and setting up an environment rather than treating it as a plug-and-play toolkit.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category