#132 · Primary category: Computer Vision
claude-real-video
Let Claude (or any LLM) actually watch a video — scene-aware, deduplicated frames + transcript, from a URL or local file. Runs locally, MIT.
Project last updated:08/28/26
GitHub Stars
2.1K
Forks
184
Contributors
9
License
MIT
Why we included this project
If you've pasted a video link into an LLM and gotten an answer built entirely from the transcript, this tool closes that gap. It processes video locally, pulling one representative frame per scene change instead of sampling at a fixed rate, dropping near-duplicates, and transcribing the audio. What you're left with is a tidy folder of images, per-frame timestamps, and text that any multimodal model can read. That makes it a practical fit for screen recordings, lecture slides, product demos, or meeting videos, where the on-screen content matters as much as the narration. It also works standalone as a plain keyframe extractor, and because everything runs locally, your source video never gets uploaded; you choose which frames or transcript to send to a cloud provider later.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
opencv
Open Source Computer Vision Library
RuView
π RuView turns commodity WiFi signals into real-time spatial intelligence, vital sign monitoring, and presence detection — all without a single pixel of video.
PaddleOCR
Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.
MinerU
Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.
tesseract
Tesseract Open Source OCR Engine (main repository)