#117 · Primary category: Foundation Models

Chinese-alpaca-lora

骆驼:A Chinese finetuned instruction LLaMA. Developed by 陈启源 @ 华中师范大学 & 李鲁鲁 @ 商汤科技 & 冷子昂 @ 商汤科技

Project last updated:05/30/23

GitHub Stars

716

Forks

81

Contributors

1

License

Apache-2.0

Why we included this project

Luotuo was one of the first community projects to give a Chinese model instruction-following behavior, fine-tuning LLaMA with LoRA on a Chinese translation of the Stanford Alpaca dataset. For anyone working with Chinese LLMs, the repo is a useful record of how a small team adapted the Alpaca recipe to another language: it walks through the data translation pipeline, the training setup, and the LoRA checkpoints (luotuo-lora-7b-0.1 and 0.3) hosted on Hugging Face. The notebooks let you evaluate the model or spin up a Gradio chat demo quickly. It is not an official SenseTime product or a maintained production service, and the authors admit the training code is still being cleaned up, so treat it as a learning resource and a starting point for your own Chinese fine-tuning experiments rather than something to deploy directly.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category