#168 · Primary category: Knowledge Base & RAG

NeumAI

ai chatgpt data data-engineering database embeddings etl llm llmops mlops ops pipeline python rag retrieval vector-database vectors

Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.

Project last updated:01/15/24

GitHub Stars

867

Forks

50

Contributors

7

License

Apache-2.0

Why we included this project

Neum AI handles the glue work of a retrieval-augmented generation setup: pulling content from sources like Postgres or S3, embedding it, and getting the vectors into a store such as Weaviate or Qdrant without hand-writing each connector. You describe the whole pipeline in plain Python, and a short run() call takes the data from raw documents to searchable vectors. Real-time synchronization keeps the index current as underlying sources change, and metadata survives ingestion, so hybrid retrieval still works later without extra plumbing. For small teams that would otherwise patch together separate ETL, embedding, and database integrations, having this data layer in one place saves real setup time.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category