#61 · Primary category: NLP Tools & Text Processing
texthero
Text preprocessing, representation and visualization from zero to hero.
Project last updated:08/29/23
GitHub Stars
2.9K
Forks
236
Contributors
21
License
MIT
Why we included this project
Texthero is a pandas-native toolkit for people who work with raw text and would rather not hand-build a preprocessing pipeline. It puts Gensim, NLTK, spaCy, and scikit-learn behind one API, so the usual chores, like stripping digits, brackets, diacritics, punctuation, and stop words or building TF-IDF and custom embeddings, reduce to a few chained calls, and clustering the results is one more step. The built-in visualizations, such as scatterplots of PCA-reduced vectors colored by cluster or topic, help you see the structure of a corpus rather than trust the numbers. It's aimed at programmers who are comfortable with pandas but not necessarily with linguistics, so the learning curve stays gentle. One caveat: the project is in beta and hasn't been updated recently, which makes it better suited to exploratory analysis and learning than to production use.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
flair
A very simple framework for state-of-the-art Natural Language Processing (NLP)
compromise
modest natural-language processing
tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
CoreNLP
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
Chinese-Word-Vectors
100+ Chinese Word Vectors 上百种预训练中文词向量