#72 · Primary category: NLP Tools & Text Processing
instructor-embedding
[ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings
Project last updated:01/15/25
GitHub Stars
2.0K
Forks
156
Contributors
15
License
Apache-2.0
Why we included this project
The practical idea behind Instructor is that you tell the model what the text is for. You pair each text with a short instruction, something like 'Represent the Science title' or 'Represent this sentence for duplicate retrieval,' and it returns a vector shaped for that task instead of a generic one. That makes it a good fit when a single model has to handle retrieval, clustering, classification, and text evaluation without any fine-tuning. The encode API is easy to call from existing Python code, and the base, large, and xl checkpoints let you choose where to sit on the speed-versus-quality curve. If you want to go beyond the released models, the training and MTEB evaluation code is there to adapt the approach to your own data.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
flair
A very simple framework for state-of-the-art Natural Language Processing (NLP)
compromise
modest natural-language processing
tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
CoreNLP
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
Chinese-Word-Vectors
100+ Chinese Word Vectors 上百种预训练中文词向量