#100 · Primary category: Foundation Models
SEED
Official implementation of SEED-LLaMA (ICLR 2024).
Project last updated:09/21/24
GitHub Stars
642
Forks
33
Contributors
5
License
Other
Why we included this project
SEED-LLaMA is a research-grade multimodal model that handles image understanding and image generation inside one large language model, which makes it a useful reference if you are studying how vision and language can be fused rather than bolted together. The repo includes the full training pipeline: the SEED tokenizer that converts visual signals into discrete tokens, plus pretraining and instruction-tuning code for the 8B and 14B variants, so researchers can reproduce the method or adapt it to their own work. The released checkpoints also run on a single 16GB or 24GB GPU thanks to 8-bit quantization and dynamic loading, and an online Gradio demo lets you try the assistant-style multimodal chat before setting anything up locally. Since this is the official implementation behind the ICLR 2024 papers, treat it as a reference codebase and research starting point rather than a turnkey product.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
CLIP
CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image
MiniCPM-V
A Pocket-Sized MLLM for Ultra-Efficient Image and Video Understanding on Your Phone
generative-models
Generative Models by Stability AI
unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities