#164 · Primary category: Computer Vision
claude-video-vision
Give Claude the ability to watch and understand videos — Claude Code plugin with frame extraction and multimodal audio analysis
Project last updated:08/07/26
GitHub Stars
1.3K
Forks
152
Contributors
7
License
MIT
Why we included this project
This is a Claude Code plugin that gives Claude a way to actually see and hear video. Rather than building its own vision pipeline, it acts as a perception layer: ffmpeg pulls frames out of a local file or YouTube URL, an audio backend (Gemini, local Whisper, or OpenAI) returns a timestamped transcript, and Claude reads both as evidence. That split works well for real jobs like debugging a screen recording, summarizing a long lecture, or checking what text shows up at a specific moment in a clip. It installs from a marketplace command with no build step, Claude tunes the extraction to how you phrase the question, and cloud or fully local backends both work, so transcription can stay on your machine if you prefer. The plugin intentionally leaves the reasoning to the underlying model, feeding Claude evidence rather than conclusions.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
opencv
Open Source Computer Vision Library
RuView
π RuView turns commodity WiFi signals into real-time spatial intelligence, vital sign monitoring, and presence detection — all without a single pixel of video.
PaddleOCR
Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.
MinerU
Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.
tesseract
Tesseract Open Source OCR Engine (main repository)