#5 · Primary category: NLP Tools & Text Processing
Chinese-Word-Vectors
100+ Chinese Word Vectors 上百种预训练中文词向量
Project last updated:10/30/23
GitHub Stars
12.2K
Forks
2.3K
Contributors
3
License
Apache-2.0
Why we included this project
If you work on Chinese NLP, this collection is a useful place to start. It bundles more than a hundred pre-trained word vector sets, covering dense SGNS and sparse PPMI representations trained on corpora from Baidu Encyclopedia and Wikipedia to People's Daily, financial news, Zhihu, and Weibo. Features span word, ngram, character, radical, and dependency variants, so you can match the representation to your task instead of training from scratch. The repo also ships the CA8 analogical reasoning dataset and an evaluation toolkit for judging how well a set handles Chinese morphological and semantic relations. Teams without large Chinese corpora or GPU time get a tested starting point, and the accompanying ACL 2018 paper makes the methodology citable.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
flair
A very simple framework for state-of-the-art Natural Language Processing (NLP)
compromise
modest natural-language processing
tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
CoreNLP
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
TextBlob
Simple, Pythonic, text processing--Sentiment analysis, part-of-speech tagging, noun phrase extraction, translation, and more.