#133 · Primary category: NLP Tools & Text Processing
uniem
unified embedding model
Project last updated:09/01/23
GitHub Stars
873
Forks
72
Contributors
6
License
Apache-2.0
Why we included this project
Chinese-language teams often struggle to find embedding models that match what English users take for granted. Uniem addresses that gap by shipping the M3E family of models on Hugging Face, and since they are fully sentence-transformers compatible, code that already loads a SentenceTransformer keeps working after you swap in the M3E name. The bundled FineTuner goes a step further, letting you fine-tune M3E, text2vec, or GPT-style checkpoints on your own data in a few lines when generic embeddings miss the mark on a domain-specific task. MTEB-zh, the included evaluation harness, runs classification and retrieval benchmarks across multiple Chinese datasets, so you can compare candidates on measured scores rather than gut feel. Teams building semantic search, RAG, or text classification for Chinese content are the obvious audience.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
flair
A very simple framework for state-of-the-art Natural Language Processing (NLP)
compromise
modest natural-language processing
tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
CoreNLP
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
Chinese-Word-Vectors
100+ Chinese Word Vectors 上百种预训练中文词向量