#104 · Primary category: NLP Tools & Text Processing
similarities
Similarities: a toolkit for similarity calculation and semantic search. 相似度计算、匹配搜索工具包,支持亿级数据文搜文、文搜图、图搜图,python3开发,开箱即用。
Project last updated:03/05/26
GitHub Stars
903
Forks
88
Contributors
5
License
Apache-2.0
Why we included this project
Similarities is a Python library that handles similarity scoring and semantic search for both text and images, so teams that only need retrieval logic can skip wiring several libraries together. Text support spans lightweight lexical methods like BM25, TF-IDF, and SimHash up through SentenceBERT and CoSENT style embeddings, and the supported search backends (Faiss, ANNOY, HNSW) keep searches fast on large corpora. On the image side it wraps CLIP for text-to-image and image-to-image retrieval, with the same indexing approach applying to both domains. It also bundles a few practical extras: a CLI that builds indexes and serves a search endpoint, community detection for grouping related results, and paraphrase mining for finding near-duplicates. For projects that want controllable retrieval without standing up a separate vector database service, this is a convenient middle ground.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
flair
A very simple framework for state-of-the-art Natural Language Processing (NLP)
compromise
modest natural-language processing
tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
CoreNLP
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
Chinese-Word-Vectors
100+ Chinese Word Vectors 上百种预训练中文词向量