#17 · Primary category: LLM Application Frameworks
haystack
Open-source AI orchestration framework for building production-ready LLM applications with modular pipelines, agent workflows, and explicit control over retrieval, routing, memory, and generation.
Project last updated:08/29/26
GitHub Stars
26.4K
Forks
3.0K
Contributors
432
License
Apache-2.0
Why we included this project
Haystack is a Python framework for building production LLM applications from small, composable components. You assemble those components into explicit pipelines, so you decide how retrieval, routing, memory, and generation fit together instead of accepting a black-box stack. That control is what makes it a good fit for RAG and agent systems where you need to know exactly what happens at each step of a request. The component model is easy to extend, and the built-in integrations cover vector stores, model providers, and document loaders, so custom logic can sit right next to the standard pieces. It is a solid choice once you are past the prototype stage and need clear seams for testing, observability, and swapping parts as requirements change.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
langchain
The agent engineering platform.
dify
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.
headroom
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
llama_index
LlamaIndex is the leading document agent and OCR platform