#85 · Primary category: NLP Tools & Text Processing
nlpcda
一键中文数据增强包 ; NLP数据增强、bert数据增强、EDA:pip install nlpcda
Project last updated:03/18/25
GitHub Stars
1.9K
Forks
171
Contributors
3
License
Apache-2.0
Why we included this project
Chinese NLP projects that run short on training text can use this package to generate more of it quickly, without collecting new corpora. It installs with pip and packs nine augmentation techniques: random entity replacement, synonym and homophone swaps, character deletion, adjacent-character shuffling, and equivalence-character substitution, plus a dedicated mode for NER data in BIO format that augments sentences and their labels together, which most utilities won't do out of the box. The author tuned it to protect meaningful details, so dates, times, and digits survive intact and the generated samples keep most of their original meaning. You can also supply your own synonym and equivalence dictionaries, which makes it easy to steer the noise toward your domain. For teams training classifiers, retrieval models, or entity taggers on Chinese text and wanting more examples without more labeling, this is a simple, installable starting point.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
flair
A very simple framework for state-of-the-art Natural Language Processing (NLP)
compromise
modest natural-language processing
tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
CoreNLP
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
Chinese-Word-Vectors
100+ Chinese Word Vectors 上百种预训练中文词向量