#56 · Primary category: Foundation Models
Liquid
(Accepted by IJCV) Liquid: Language Models are Scalable and Unified Multi-modal Generators
Project last updated:06/01/26
GitHub Stars
640
Forks
35
Contributors
4
License
MIT
Why we included this project
Liquid is a research codebase that tests a fairly bold idea: one large language model can both understand and generate images, with no separate pretrained encoder like CLIP in the loop. The released 7B instruction-tuned checkpoint does both, so the same weights can answer questions about a picture and then produce a photorealistic image from a text prompt. It ships with a Gradio demo, inference scripts for text-to-image, image-to-text, and text-to-text, plus evaluation and training code, so you can actually run it rather than just read the paper. The authors also report scaling results from 0.5B to 32B across three model families, which is useful if you are deciding whether unified training is worth the compute at your own scale. For researchers working on multimodal foundation models, the checkpoints and reproduction scripts are the most useful part.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
CLIP
CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image
MiniCPM-V
A Pocket-Sized MLLM for Ultra-Efficient Image and Video Understanding on Your Phone
generative-models
Generative Models by Stability AI
unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities