#178 · Primary category: MLOps & Evaluation

simple-llm-finetuner

ai gpt-2 gpt-3 huggingface huggingface-transformers llama llm peft pytorch

Simple UI for LLM Model Finetuning

Project last updated:12/21/23

GitHub Stars

2.1K

Forks

131

Contributors

5

License

MIT

Why we included this project

The project is a Gradio interface for running LoRA fine-tuning on Hugging Face models such as GPT and LLaMA through the PEFT library. It targets people who want to see how adapter training actually works without hand-writing training loops: you paste text samples separated by blank lines, adjust hyperparameters explained in the UI, train on a single NVIDIA GPU, and then open an inference tab to try the adapter you just built. The author flags the repository as effectively dead and points users to LLaMA-Factory, Unsloth, and text-generation-webui, so it is not something to build on. Its remaining value is as a compact, readable reference for how LoRA and PEFT workflows fit together, and for getting a feel for the dataset format these tools expect.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category