#201 · Primary category： Video & Animation
Video-ChatGPT
An open-source video conversation model that generates detailed, meaningful dialogue about video content by combining LLMs with spatiotemporal visual encoding, featuring a quantitative benchmarking framework.
Project last updated：08/05/25
GitHub Stars
1.5K
Forks
128
Contributors
4
License
Other
Why we included this project
Video-ChatGPT attaches a pretrained visual encoder that tracks spatial and temporal detail to a language model, so the system can answer questions about what actually happens in a clip instead of treating the footage as one still frame. That makes it a practical base for video Q&A assistants, captioning pipelines, accessibility features, or search tools that need to reason about motion and sequence. The repo also ships the quantitative evaluation benchmark from the ACL 2024 paper along with the video instruction data used for training, so teams can measure other video conversation models against the same standard rather than trust demo clips. If you are experimenting with multimodal understanding, this is a useful codebase for getting a chat model to talk about moving images.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
yt-dlp
A feature-rich command-line audio/video downloader
MoneyPrinterTurbo
Generate HD short videos from a topic or keyword with an automated AI workflow.
Deep-Live-Cam
real time face swap and one-click video deepfake with only a single image
manim
Animation engine for explanatory math videos
anime
JavaScript animation engine