#86 · Primary category： Foundation Models
dolly
Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform
Project last updated：06/30/23
GitHub Stars
10.8K
Forks
1.1K
Contributors
14
License
Apache-2.0
Why we included this project
Dolly stands out less for raw performance than for what it demonstrates: Databricks fine-tuned EleutherAI's Pythia-12b base on roughly 15,000 instruction and response pairs written by its own employees, then released the commercially licensed result along with the training pipeline. For teams that want to learn how to adapt a pretrained model on their own infrastructure rather than just download one, the repository is a genuinely useful starting point, with the notebook and pipeline that produced the model. It is also refreshingly honest about its limits: the 12B checkpoint is not state of the art, and the README calls out weak spots like coding, math, and hallucination. Treat it as a foundation model to study or build on, not a drop-in assistant for production.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
CLIP
CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image
MiniCPM-V
A Pocket-Sized MLLM for Ultra-Efficient Image and Video Understanding on Your Phone
generative-models
Generative Models by Stability AI
unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities