#159 · Primary category: NLP Tools & Text Processing

ckip-transformers

ckip language-model named-entity-recognition part-of-speech-tagging transformers word-segmentation

CKIP Transformers

Project last updated:04/21/23

GitHub Stars

774

Forks

81

Contributors

3

License

GPL-3.0

Why we included this project

Traditional Chinese is underserved by most open-source NLP tooling, and ckip-transformers is one of the few maintained options built around it. The package wraps ALBERT, BERT, and GPT2 models trained by the CKIP group at Academia Sinica, so you get pretrained weights and a straightforward Python API rather than having to train Chinese models yourself. Since the models are published on Hugging Face, they drop into the standard transformers pipeline and can be fine-tuned on your own labeled data with minimal glue code. Teams working on Chinese search, document processing, or annotation workflows get working task models out of the box, and the documentation covers both inference and fine-tuning with runnable examples.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category