#194 · Primary category: NLP Tools & Text Processing
word_forms
Accurately generate all possible forms of an English word e.g "election" --> "elect", "electoral", "electorate" etc.
Project last updated:06/24/21
GitHub Stars
629
Forks
68
Contributors
8
License
MIT
Why we included this project
Most NLP tooling reduces a word to a single base form, which is fine until you need to match 'run' with 'ran' or treat 'politician' and 'politics' as the same thing. word_forms takes the opposite approach: one function returns every related surface form, so 'president' comes back with 'presidential', 'presidency', and the verb 'preside' all at once. The result is a plain dictionary keyed by part of speech, and a similarity threshold lets you tune how far the library reaches. That makes it handy for search normalization, text analytics, or any preprocessing step where you want related words to count as one concept without writing your own morphology rules.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
flair
A very simple framework for state-of-the-art Natural Language Processing (NLP)
compromise
modest natural-language processing
tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
CoreNLP
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
Chinese-Word-Vectors
100+ Chinese Word Vectors 上百种预训练中文词向量