#114 · Primary category: NLP Tools & Text Processing
TextInfoExp
NLP experiments with Sogou dataset: TF-IDF, text classification, clustering, word vectors, sentiment recognition, relation extraction, etc.
Project last updated:07/18/22
GitHub Stars
1.7K
Forks
753
Contributors
2
License
Other
Why we included this project
This repository holds a set of Chinese NLP experiments built around the Sogou news corpus. Instead of shipping one deployable tool, it walks through the classic text-processing pipeline piece by piece: TF-IDF, classification, clustering, word2vec, sentiment analysis, and relation extraction, each with working code you can read and adapt. For students or developers who learn better from concrete examples than from theory, that is exactly what makes it useful. The code targets Python 2.7 and reads like older course material, but the underlying algorithms still translate cleanly to modern libraries. If you are putting together a Chinese text-mining lab or just want readable reference implementations to borrow from, this is a good starting point.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
flair
A very simple framework for state-of-the-art Natural Language Processing (NLP)
compromise
modest natural-language processing
tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
CoreNLP
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
Chinese-Word-Vectors
100+ Chinese Word Vectors 上百种预训练中文词向量