#184 · Primary category: Deep Learning Frameworks

Alpaca-CoT

alpaca chatglm chatgpt cot instruction-tuning llama llm lora moss p-tuning parameter-efficient pytorch tabul tabular-data tabular-model

Alpaca-CoT is an instruction-tuning platform with a unified interface for instruction data, multiple LLMs, and parameter-efficient methods like LoRA and P-Tuning.

Project last updated:12/12/23

GitHub Stars

2.8K

Forks

247

Contributors

31

License

Apache-2.0

Why we included this project

If you're fine-tuning large language models and want to test different base models and parameter-efficient tricks like LoRA or p-tuning without stitching together a new pipeline every time, this project gives you a single interface to work from. It bundles instruction-following and chain-of-thought datasets alongside the training code, so you can reproduce published instruction-tuning results or compare how different models handle the same prompt data. The focus is on research convenience rather than a polished product, so expect to adapt the code to your own setup and pull the actual datasets and model weights from the companion Hugging Face repositories.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category