#184 · Primary category: Deep Learning Frameworks
Alpaca-CoT
Alpaca-CoT is an instruction-tuning platform with a unified interface for instruction data, multiple LLMs, and parameter-efficient methods like LoRA and P-Tuning.
Project last updated:12/12/23
GitHub Stars
2.8K
Forks
247
Contributors
31
License
Apache-2.0
Why we included this project
If you're fine-tuning large language models and want to test different base models and parameter-efficient tricks like LoRA or p-tuning without stitching together a new pipeline every time, this project gives you a single interface to work from. It bundles instruction-following and chain-of-thought datasets alongside the training code, so you can reproduce published instruction-tuning results or compare how different models handle the same prompt data. The focus is on research convenience rather than a polished product, so expect to adapt the code to your own setup and pull the actual datasets and model weights from the companion Hugging Face repositories.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
tensorflow
An Open Source Machine Learning Framework for Everyone
pytorch
Tensors and Dynamic neural networks in Python with strong GPU acceleration
keras
Deep Learning for humans
nanoGPT
The simplest, fastest repository for training/finetuning medium-sized GPTs.
ray
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.