#151 · Primary category: LLM Application Frameworks
langcorn
⛓️ Serving LangChain LLM apps and agents automagically with FastApi. LLMops
Project last updated:07/15/24
GitHub Stars
938
Forks
69
Contributors
4
License
MIT
Why we included this project
Once you have a LangChain chain or agent working in your notebook, the next question is usually how to expose it over HTTP. LangCorn answers that by inspecting your chain definition and generating a FastAPI server for you, complete with routes, interactive docs, and optional token auth, so other services and frontends can call your model in a few minutes. It also handles the serving boilerplate teams otherwise redo by hand, such as async processing, running multiple chains on a single server, per-request model parameters, and chat memory passed through the payload. For small teams that want to deliver LangChain work as a clean, documented API without writing the serving layer from scratch, it is a practical bridge. The project has been quiet for a while, so it is worth checking whether its patterns still match the LangChain version you are using.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
langchain
The agent engineering platform.
dify
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.
headroom
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
llama_index
LlamaIndex is the leading document agent and OCR platform