MagicDance

Why we included this project

MagicDance, published at ICML 2024 under the name MagicPose, retargets a person's pose and facial expressions onto a different identity while keeping the subject recognizable. It builds on Stable Diffusion with a ControlNet-style pose branch and an appearance-disentangled control module, which lets you animate a still photo from a pose sequence. The repo includes inference and training scripts, including multi-GPU training, and the README walks through preparing your own video data with OpenPose pose maps. It is research code, so you will need your own GPU setup and pose-detection pipeline, but for teams working on character animation or motion transfer it is a practical reference.