#40 · Primary category: Education & Research

happy-llm

agent llm rag

📚 Building large models from scratch

Project last updated:08/08/26

GitHub Stars

33.3K

Forks

3.2K

Contributors

33

License

Other

Why we included this project

For developers who have used LLMs through APIs or existing tools but never looked under the hood, this free tutorial fills that gap. It starts with NLP basics, then covers the Transformer architecture, pretraining, and fine-tuning, and ends with building a complete LLaMA2-style model from scratch. The lessons pair explanations with code exercises built on mainstream frameworks, so you can actually train a small model instead of just reading about it. Later chapters cover applied techniques like RAG and agents, which makes the jump from model internals to real systems easier. Since it's organized as an open textbook with an online reading site, it works well as a self-paced course or as material for a study group.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category