#110 · Primary category: NLP Tools & Text Processing
eda_nlp
Data augmentation for NLP, presented at EMNLP 2019
Project last updated:03/19/23
GitHub Stars
1.7K
Forks
312
Contributors
2
License
Other
Why we included this project
Hand-labeling a text classification dataset is expensive, and when you only have a few hundred examples, every extra training sentence counts. This reference implementation of EDA, the data augmentation method from EMNLP 2019, stretches what you have by generating paraphrase-like variants of your existing sentences using four simple editing operations: swapping words for synonyms, inserting random synonyms, swapping word positions, and deleting a few words at random. No external language model is trained, only WordNet synonyms and NLTK are needed, so you can plug it into a current pipeline in minutes and rerun your classifier to see the difference. The paper behind it reported the biggest gains on training sets under 500 examples, which is exactly where scarce hand-labeled data makes augmentation worthwhile. If you want a lightweight, reproducible way to expand a corpus before trying heavier synthetic-data tools, this is a solid place to start.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
flair
A very simple framework for state-of-the-art Natural Language Processing (NLP)
compromise
modest natural-language processing
tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
CoreNLP
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
Chinese-Word-Vectors
100+ Chinese Word Vectors 上百种预训练中文词向量