#20 · Primary category: NLP Tools & Text Processing
ansj_seg
ansj分词.ict的真正java实现.分词效果速度都超过开源版的ict.
Project last updated:11/19/23
GitHub Stars
6.5K
Forks
2.3K
Contributors
41
License
Apache-2.0
Why we included this project
ansj_seg has been segmenting Chinese text in Java since 2012, and it still holds up well for JVM teams that want a tokenizer they can drop in and trust. It blends n-Gram, CRF, and HMM models into a few segmentation modes: an accurate default for general use, one that leans on your own user dictionary, and an NLP-specific analysis for tasks that need more. Beyond plain word boundaries it does Chinese name recognition and part-of-speech tagging, and it adds keyword extraction, automatic summarization, and custom dictionary support, so downstream code does not have to reimplement those pieces. The library ships as a Maven artifact with simple parse calls, which keeps integration light. If you need fast, accurate Chinese segmentation without building your own, this mature project is worth testing against your own data.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
flair
A very simple framework for state-of-the-art Natural Language Processing (NLP)
compromise
modest natural-language processing
tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
CoreNLP
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
Chinese-Word-Vectors
100+ Chinese Word Vectors 上百种预训练中文词向量