#133 · Primary category: NLP Tools & Text Processing

uniem

embeddings huggingface nlp sentence-embeddings sentence-transformers

unified embedding model

Project last updated:09/01/23

GitHub Stars

873

Forks

72

Contributors

6

License

Apache-2.0

Why we included this project

Chinese-language teams often struggle to find embedding models that match what English users take for granted. Uniem addresses that gap by shipping the M3E family of models on Hugging Face, and since they are fully sentence-transformers compatible, code that already loads a SentenceTransformer keeps working after you swap in the M3E name. The bundled FineTuner goes a step further, letting you fine-tune M3E, text2vec, or GPT-style checkpoints on your own data in a few lines when generic embeddings miss the mark on a domain-specific task. MTEB-zh, the included evaluation harness, runs classification and retrieval benchmarks across multiple Chinese datasets, so you can compare candidates on measured scores rather than gut feel. Teams building semantic search, RAG, or text classification for Chinese content are the obvious audience.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category