#140 · Primary category: Video & Animation

SystemAnimatorOnline

augmented-reality electron-app mediapipe motion-capture tensorflowjs threejs vtuber webgl webxr

XR Animator, AI-based Full Body Motion Capture and Extended Reality (XR) solution, powered by System Animator Online

Project last updated:08/02/26

GitHub Stars

1.8K

Forks

169

Contributors

2

License

Other

Why we included this project

VTubers and streamers who want a 3D avatar without buying a mocap suit can get surprisingly far with this project. It runs MediaPipe and TensorFlow.js pose detection in the browser, tracking your face, body, and hands, and maps that onto an MMD or VRM model in real time. The web app works on desktop and mobile, and there's an Electron build for Windows, Linux, and macOS. Beyond live tracking it records motion to VMD/BVH/glTF, plays back existing VMD/FBX/BVH clips, and speaks the VMC protocol, so the animation can feed into VSeeFace, VNyan, or Warudo. On Android Chrome the AR mode places the avatar in your actual surroundings, and the transparent-window option turns it into an OBS overlay. For solo creators or small teams that want a self-contained motion-capture pipeline without proprietary hardware, this is a practical starting point that's still being maintained.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category