#82 · Primary category: Foundation Models
OpenCoder-llm
The Open Cookbook for Top-Tier Code Large Language Model
Project last updated:12/08/24
GitHub Stars
2.1K
Forks
127
Contributors
5
License
MIT
Why we included this project
OpenCoder is a family of open code language models that releases more than just weights. Along with the 1.5B and 8B base and chat checkpoints, it publishes the cleaned pretraining corpus, the data filtering pipeline, intermediate training checkpoints, and an evaluation framework. Teams that want to train or fine-tune their own code-specialized model without relying on a closed API will find a solid reference here. For researchers working on code intelligence or anyone who needs a reproducible baseline, the value is in the transparency: you can see exactly how the data was cleaned and deduplicated, then reuse those steps. It is not a drop-in coding assistant so much as a documented path to building a competitive code LLM from scratch.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
CLIP
CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image
MiniCPM-V
A Pocket-Sized MLLM for Ultra-Efficient Image and Video Understanding on Your Phone
generative-models
Generative Models by Stability AI
unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities