#383 · Primary category: Computer Vision

natural-language-youtube-search

clip computer-vision machine-learning search youtube

Search inside YouTube videos using natural language

Project last updated:10/15/21

GitHub Stars

935

Forks

70

Contributors

3

License

MIT

Why we included this project

Long driving recordings, security footage, and personal clip archives share the same problem: when you know something appears in there, finding the exact moment usually means scrubbing through the whole video. This project attacks that by downloading a YouTube video, sampling frames on a regular interval, and encoding each one with OpenAI's CLIP, so you can type a plain-language query like "a fire truck" and get back the frames that match. It is a well-documented Jupyter notebook you can run in Google Colab with almost no setup, which makes it a practical way for engineers to see a complete CLIP-based retrieval pipeline end to end and then adapt it to their own footage. The example searches in the walkthrough are unusually concrete, so you can watch the query-to-frame matching work before deciding whether the approach fits your content. Keep in mind this is a demonstration rather than a maintained application, so production-scale indexing will mean doing your own packaging.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category