#353 · Primary category: Computer Vision

Gesture-Controlled-Virtual-Mouse

chat-bot computer-vision cse-project eel-python final-year-project gesture-recognition machine-learning mediapipe mediapipe-hands opencv python python3 voice-assistant voice-recognition

Virtually controlling computer using hand-gestures and voice commands. Using MediaPipe, OpenCV Python.

Project last updated:11/13/23

GitHub Stars

853

Forks

254

Contributors

4

License

GPL-3.0

Why we included this project

Most of us only control a computer by touching something, a mouse, a trackpad, a keyboard. This project is a compact demonstration of getting around that with nothing but a webcam and Python. It uses MediaPipe's hand tracking and OpenCV to map static and dynamic gestures to cursor movement, left clicks, and right clicks, and it layers voice commands on top, so you can also drive the desktop by talking. The whole pipeline, from camera frame to mouse event, sits in a single educational build instead of being spread across a large framework, which makes it much easier to trace and modify. It currently targets Windows and pins Python 3.8.5, so it is not something you would ship to production, but for accessibility experiments, touchless kiosk demos, or a classroom lab in computer vision and human-computer interaction, it is a good place to start.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category