#122 · Primary category: Foundation Models

Cornucopia-LLaMA-Fin-Chinese

chinese finance large-language-models llama nlp qa rlhf sft text-generation transformers

聚宝盆(Cornucopia): 中文金融系列开源可商用大模型,并提供一套高效轻量化的垂直领域LLM训练框架(Pretraining、SFT、RLHF、Quantize等)

Project last updated:06/30/23

GitHub Stars

656

Forks

66

Contributors

1

License

Apache-2.0

Why we included this project

Anyone building a Chinese-language finance assistant or Q&A tool can start here without training a model from scratch. The repo ships LoRA adapter weights that turn LLaMA-family base models into versions tuned on Chinese financial question-answer data, with adapters built on both the original Meta LLaMA and the Chinese-LLaMA base. It also documents the instruction-tuning pipeline, including how the training data was assembled from public and scraped financial Q&A sources covering insurance, wealth management, stocks, funds, loans, and credit cards. Inference and fine-tuning scripts plus sample prompts are included, so the project works both as a drop-in finance-aware model and as a reference for reproducing a similar domain fine-tune on your own data.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category