#145 · Primary category: LLM Application Frameworks
llm-chain
`llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks
Project last updated:10/31/24
GitHub Stars
1.6K
Forks
140
Contributors
41
License
MIT
Why we included this project
Rust teams building LLM-backed services get a structured way to compose multi-step prompt pipelines here, instead of hand-wiring every API call. You define reusable prompt templates and chain them so a task no single model call can handle gets broken into ordered steps, with support for cloud providers like OpenAI and locally hosted models such as LLaMa and Alpaca. The crate also ships vector store integrations for long-term memory, plus a tools layer that lets agents run shell commands, execute Python, or search the web mid-chain. That combination is a practical base for chatbots and summarizers, and it extends to agent-style applications in a systems language. For teams already committed to Rust, the typed executor and prompt macros are a more ergonomic fit than wrapping a Python framework from their codebase.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
langchain
The agent engineering platform.
dify
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.
headroom
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
llama_index
LlamaIndex is the leading document agent and OCR platform