#222 · Primary category: Video & Animation
Everlyn-1
The first open autoregressive foundational video AI model.
Project last updated:10/14/24
GitHub Stars
2.9K
Forks
486
Contributors
2
License
Other
Why we included this project
Everlyn-1 is an open research release for teams who want video generation built on an autoregressive foundation rather than the diffusion pipeline most models follow. The repo splits that goal into three parts, each with its own linked project you can inspect on its own: a Wasserstein-distance vector quantizer that stabilizes tokenization and improves codebook utilization, an efficient autoregressive backbone for joint image and video generation, and a decoding strategy called TAME that reduces hallucinated objects in multimodal LLMs. Because the pieces live separately, you can borrow just the one that fits your work, say the quantizer if you are training a video tokenizer or TAME if you are tuning an MLLM. It reads more like an architecture blueprint and a set of methods than a turnkey model you download and run. Researchers and engineers prototyping autoregressive video will get the most out of it, particularly where training stability and codebook utilization have been the stumbling blocks.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
yt-dlp
A feature-rich command-line audio/video downloader
MoneyPrinterTurbo
Generate HD short videos from a topic or keyword with an automated AI workflow.
Deep-Live-Cam
real time face swap and one-click video deepfake with only a single image
manim
Animation engine for explanatory math videos
anime
JavaScript animation engine