langroid

Why we included this project

Langroid is a Python framework for coordinating several LLM-backed agents, built by researchers at CMU and UW-Madison. You define agents, attach optional pieces like an LLM, vector store, or function-calling tools, and let them tackle tasks by exchanging messages with one another. Its authors deliberately left LangChain out of the picture, and it works with any model behind an OpenAI-compatible API, so local servers such as Ollama are fair game. That appeals to teams wanting direct control over multi-agent conversations and RAG-style document chat without adopting a heavier ecosystem. The repo documents real production deployments, and its examples for local-LLM extraction and structured data pulling offer a quick way to test the waters before committing.