#122 · Primary category: Foundation Models
Cornucopia-LLaMA-Fin-Chinese
聚宝盆(Cornucopia): 中文金融系列开源可商用大模型,并提供一套高效轻量化的垂直领域LLM训练框架(Pretraining、SFT、RLHF、Quantize等)
Project last updated:06/30/23
GitHub Stars
656
Forks
66
Contributors
1
License
Apache-2.0
Why we included this project
Anyone building a Chinese-language finance assistant or Q&A tool can start here without training a model from scratch. The repo ships LoRA adapter weights that turn LLaMA-family base models into versions tuned on Chinese financial question-answer data, with adapters built on both the original Meta LLaMA and the Chinese-LLaMA base. It also documents the instruction-tuning pipeline, including how the training data was assembled from public and scraped financial Q&A sources covering insurance, wealth management, stocks, funds, loans, and credit cards. Inference and fine-tuning scripts plus sample prompts are included, so the project works both as a drop-in finance-aware model and as a reference for reproducing a similar domain fine-tune on your own data.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
CLIP
CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image
MiniCPM-V
A Pocket-Sized MLLM for Ultra-Efficient Image and Video Understanding on Your Phone
generative-models
Generative Models by Stability AI
unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities