#46 · Primary category: Foundation Models
NEO
NEO Series: Native Vision-Language Models from First Principles
Project last updated:07/27/26
GitHub Stars
888
Forks
31
Contributors
3
License
Apache-2.0
Why we included this project
NEO comes at multimodal modeling from an angle most VLM projects don't: instead of attaching a separate vision encoder to an LLM, it trains pixels and text together inside a single dense architecture. The repo backs that idea with real artifacts. 2B and 9B checkpoints on Hugging Face, the training recipes used to build them, and an evaluation harness let you reproduce the reported results or fine-tune a model for your own task rather than taking the papers on faith. The efficiency claim is what makes it interesting: the authors say visual understanding is comparable to modular systems while training on a fraction of the image-text data. Anyone weighing current open vision-language approaches, especially teams curious about encoder-free designs, will find working code here and a useful reference point.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
CLIP
CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image
MiniCPM-V
A Pocket-Sized MLLM for Ultra-Efficient Image and Video Understanding on Your Phone
generative-models
Generative Models by Stability AI
unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities