#39 · Primary category: Prompt Engineering Tools

prompttools

deep-learning developer-tools embeddings large-language-models llms machine-learning prompt-engineering python vector-search

Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).

Project last updated:02/11/26

GitHub Stars

3.1K

Forks

257

Contributors

12

License

Apache-2.0

Why we included this project

Developers comparing LLM outputs often end up pasting the same prompt into several chat windows. PromptTools lets you do that in code instead: you define an experiment across OpenAI, Anthropic, or LLaMA models, sweep temperature settings, and get a visualization of the results. The same harness extends to vector databases, so you can check retrieval accuracy on Chroma, Weaviate, or LanceDB without building your own test scaffold. It's a self-hostable Python library that.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category