#151 · Primary category: LLM Application Frameworks

langcorn

api fastapi langchain langchain-python large-language-models llm llmops openai-api rest-api vercel vercel-serverless-functions

⛓️ Serving LangChain LLM apps and agents automagically with FastApi. LLMops

Project last updated:07/15/24

GitHub Stars

938

Forks

69

Contributors

4

License

MIT

Why we included this project

Once you have a LangChain chain or agent working in your notebook, the next question is usually how to expose it over HTTP. LangCorn answers that by inspecting your chain definition and generating a FastAPI server for you, complete with routes, interactive docs, and optional token auth, so other services and frontends can call your model in a few minutes. It also handles the serving boilerplate teams otherwise redo by hand, such as async processing, running multiple chains on a single server, per-request model parameters, and chat memory passed through the payload. For small teams that want to deliver LangChain work as a clean, documented API without writing the serving layer from scratch, it is a practical bridge. The project has been quiet for a while, so it is worth checking whether its patterns still match the LangChain version you are using.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category