#44 · Primary category: NLP Tools & Text Processing

SimCSE

nlp sentence-embeddings

[EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821

Project last updated:10/16/24

GitHub Stars

3.7K

Forks

537

Contributors

13

License

MIT

Why we included this project

SimCSE is the reference implementation behind the EMNLP 2021 paper on simple contrastive learning of sentence embeddings. The unsupervised version learns from plain text alone, using standard dropout as noise, while the supervised variant feeds on NLI data, treating entailment pairs as positives and contradictions as hard negatives. Pretrained checkpoints load directly through the bundled sentence-embedding tool or Hugging Face, so you can get usable vectors without retraining anything. Training and evaluation code is included too, which matters if you want to reproduce the reported numbers or adapt the approach to your own data. For teams weighing sentence-embedding options, having the original implementation and its evaluation scripts together beats reimplementing from the paper.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category