#489 · Primary category: Education & Research

FineTuningLLMs

bitsandbytes fine-tuning finetuning finetuning-llms hugging-face huggingface large-language-models llamacpp lora ollama peft peft-fine-tuning-llm pytorch transformers

Official repository of my book "A Hands-On Guide to Fine-Tuning LLMs with PyTorch and Hugging Face"

Project last updated:02/28/26

GitHub Stars

858

Forks

116

Contributors

1

License

MIT

Why we included this project

This is Daniel Godoy's official companion to his book on fine-tuning LLMs, but the notebooks stand on their own as a tutorial. Each chapter is a Jupyter notebook you can open directly in Google Colab and run on a free GPU, walking through loading a quantized model, configuring LoRA adapters, formatting your dataset, training with SFTTrainer, and exporting a GGUF file you can serve locally with Ollama or llama.cpp. If you already work with PyTorch and the Hugging Face stack and want to actually fine-tune a model on a single consumer GPU rather than only read theory, the code here is a concrete route through the full process. The notebooks also make a handy reference to adapt when you start your own fine-tuning work.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category