#821 · Primary category: Education & Research

examples

audio-classification cross-modal embeddings image-classification machine-learning nlp video-tagging

Analyze the unstructured data with Towhee, such as reverse image search, reverse video search, audio classification, question and answer systems, molecular search, etc.

Project last updated:02/09/24

GitHub Stars

519

Forks

122

Contributors

20

License

Apache-2.0

Why we included this project

The examples repo is a set of Jupyter notebooks built on the Towhee embedding framework, and it may be the easiest way to see an x2vec-style pipeline working from one end to the other. The bootcamp notebooks walk through concrete retrieval and classification tasks: reverse image search, reverse video search, audio classification, cross-modal text-to-image retrieval, and molecular similarity search. Each one pairs the pipeline with the operators underneath it, like ResNet, CLIP, DPR, or RDKit, so you can watch how a chain of models plus an approximate-nearest-neighbor index comes together. A fine-tuning tutorial and a getting-started pipeline primer round out the collection, which makes the whole thing a workbook for developers and tech leads rather than something to deploy. The examples favor clarity over optimization, so treat them as templates you adapt, not services you drop in.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category