#117 · Primary category: Foundation Models
Chinese-alpaca-lora
骆驼:A Chinese finetuned instruction LLaMA. Developed by 陈启源 @ 华中师范大学 & 李鲁鲁 @ 商汤科技 & 冷子昂 @ 商汤科技
Project last updated:05/30/23
GitHub Stars
716
Forks
81
Contributors
1
License
Apache-2.0
Why we included this project
Luotuo was one of the first community projects to give a Chinese model instruction-following behavior, fine-tuning LLaMA with LoRA on a Chinese translation of the Stanford Alpaca dataset. For anyone working with Chinese LLMs, the repo is a useful record of how a small team adapted the Alpaca recipe to another language: it walks through the data translation pipeline, the training setup, and the LoRA checkpoints (luotuo-lora-7b-0.1 and 0.3) hosted on Hugging Face. The notebooks let you evaluate the model or spin up a Gradio chat demo quickly. It is not an official SenseTime product or a maintained production service, and the authors admit the training code is still being cleaned up, so treat it as a learning resource and a starting point for your own Chinese fine-tuning experiments rather than something to deploy directly.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
CLIP
CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image
MiniCPM-V
A Pocket-Sized MLLM for Ultra-Efficient Image and Video Understanding on Your Phone
generative-models
Generative Models by Stability AI
unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities