#40 · Primary category: Education & Research
happy-llm
📚 Building large models from scratch
Project last updated:08/08/26
GitHub Stars
33.3K
Forks
3.2K
Contributors
33
License
Other
Why we included this project
For developers who have used LLMs through APIs or existing tools but never looked under the hood, this free tutorial fills that gap. It starts with NLP basics, then covers the Transformer architecture, pretraining, and fine-tuning, and ends with building a complete LLaMA2-style model from scratch. The lessons pair explanations with code exercises built on mainstream frameworks, so you can actually train a small model instead of just reading about it. Later chapters cover applied techniques like RAG and agents, which makes the jump from model internals to real systems easier. Since it's organized as an open textbook with an online reading site, it works well as a self-paced course or as material for a study group.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
prompts.chat
f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-host for your organization with complete privacy.
JavaGuide
Java Interview & Backend General Interview Guide, covering computer fundamentals, databases, distributed systems, high concurrency, system design, and AI application development.
system-prompts-and-models-of-ai-tools
A curated collection of system prompts, internal tools, and AI models from popular AI assistants and coding agents.
30-seconds-of-code
Coding articles to level up your development skills
generative-ai-for-beginners
21 Lessons, Get Started Building with Generative AI