#50 · Primary category： LLM Application Frameworks
Guardrails
NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
Project last updated：08/27/26
GitHub Stars
7.0K
Forks
813
Contributors
127
License
Other
Why we included this project
For teams shipping LLM-powered assistants to production, a single system prompt rarely provides enough control. NeMo Guardrails defines explicit conversation flows in Colang and attaches named rails that intercept both user inputs and model outputs. You can block off-topic or malicious requests, steer the model away from sensitive subjects, validate responses, and alter them before they reach the user. Because the rails are written as code, they are testable and portable across different underlying LLMs, making them more auditable than prompt-level guardrails alone. For developers who need policy-driven safety that doesn't depend on one fragile prompt, this is a practical toolkit.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
langchain
The agent engineering platform.
dify
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.
headroom
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
llama_index
LlamaIndex is the leading document agent and OCR platform