#204 · Primary category: NLP Tools & Text Processing
weixin_public_corpus
WeChat public account corpus
Project last updated:01/07/19
GitHub Stars
595
Forks
162
Contributors
3
License
Other
Why we included this project
For anyone doing Chinese NLP, this is a rare find: a few gigabytes of real WeChat public account articles, already stripped of HTML and stored as one JSON object per line with the account name, ID, title, and body. That format drops straight into pandas or a text pipeline, so it works well for language modeling, topic classification, or sentiment work on contemporary Chinese. The data comes in password-free zip volumes with a preview file, so you can check the content before downloading the whole thing. Keep in mind it is a research corpus, not a maintained tool: you will do your own cleaning, and the collection has not been updated since 2019.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
flair
A very simple framework for state-of-the-art Natural Language Processing (NLP)
compromise
modest natural-language processing
tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
CoreNLP
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
Chinese-Word-Vectors
100+ Chinese Word Vectors 上百种预训练中文词向量