#55 · Primary category: Foundation Models
Show-o
[ICLR & NeurIPS 2025] Repository for Show-o series, One Single Transformer to Unify Multimodal Understanding and Generation.
Project last updated:01/08/26
GitHub Stars
2.0K
Forks
94
Contributors
9
License
Apache-2.0
Why we included this project
Show-o is a research codebase from NUS Show Lab and ByteDance that folds image and text understanding together with image generation into one transformer, so a single model can caption a photo, answer visual questions, and synthesize new images from a prompt without shuttling between separate systems. Text is decoded autoregressively while image tokens are produced with discrete diffusion, and the Show-o2 follow-up extends the same approach to video and mixed-modality generation at 1.5B and 7B scale. If you are experimenting with native unified multimodal models rather than stitching a vision encoder onto a standalone diffusion pipeline, the repo gives you training and inference code, pretrained weights, and a live Hugging Face demo to try before you build anything. It also works as a reference for how causal and full attention can coexist for different token types. Expect research-grade code with configs and ablation tables, not a plug-and-play product; that is exactly what makes it a decent starting point for digging into the architecture.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
CLIP
CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image
MiniCPM-V
A Pocket-Sized MLLM for Ultra-Efficient Image and Video Understanding on Your Phone
generative-models
Generative Models by Stability AI
unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities