#264 · Primary category: Computer Vision

temporal-shift-module

acceleration efficient-model low-latency nvidia-jetson-nano temporal-modeling tsm video-understanding

[ICCV 2019] TSM: Temporal Shift Module for Efficient Video Understanding

Project last updated:07/11/24

GitHub Stars

2.2K

Forks

421

Contributors

6

License

MIT

Why we included this project

Video understanding usually means paying a steep compute bill, but TSM shows how to get most of the benefit for a fraction of the cost. Its temporal shift module moves feature maps across time so a plain 2D CNN can model motion between frames without 3D convolutions or optical flow, which is what makes the approach attractive on edge devices. The repo has PyTorch training code, pre-trained Kinetics weights, and the setup needed to reproduce the published numbers or fine-tune for your own action recognition. There is even an online demo running real-time hand gesture recognition on a Jetson Nano at 8 watts, so you can see the method work on actual hardware rather than just in a paper.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category