#30 · Primary category: NLP Tools & Text Processing
text2vec
text2vec, text to vector.
Project last updated:02/14/26
GitHub Stars
5.0K
Forks
428
Contributors
5
License
Apache-2.0
Why we included this project
Teams doing Chinese semantic search or duplicate detection often need to turn sentences and paragraphs into dense vectors, and text2vec makes that work straightforward. It packages Word2Vec, Sentence-BERT, and CoSENT behind one Python API, so you can try a fast literal-matching baseline and a heavier learned encoder without building each one from scratch. The project reports that CoSENT converges faster and beats classic SBERT on Chinese matching benchmarks, and it publishes per-model QPS and STS results so you can pick a sensible default before committing. Pretrained Chinese models ship ready to use, and the training code is there if you want to fine-tune on your own data. For teams working mostly in Chinese, that combination is usually the difference between a weekend prototype and wiring a sentence encoder into production yourself.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
flair
A very simple framework for state-of-the-art Natural Language Processing (NLP)
compromise
modest natural-language processing
tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
CoreNLP
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
Chinese-Word-Vectors
100+ Chinese Word Vectors 上百种预训练中文词向量