#91 · Primary category： Inference & Local Deploy
opyrator
🪄 Turns your machine learning code into microservices with web API, interactive GUI, and more.
Project last updated：08/25/26
GitHub Stars
3.1K
Forks
167
Contributors
4
License
MIT
Why we included this project
Opyrator is for the common situation where you have a working model or Python function and would rather not build a Flask app around it just to let people try it. You declare the inputs and outputs with Pydantic type hints, run a single command, and the same code becomes either a FastAPI HTTP endpoint or a Streamlit-based interactive UI. Those type hints double as the request and response schemas, so the generated OpenAPI contract is documented without extra work. Services can also be exported as a self-contained executable or a Docker image, which is handy for handing a demo to a teammate or client. The project is still alpha, so treat it as a fast path to prototypes and internal tools rather than something to run in production long term.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
ollama
Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
llama.cpp
LLM inference in C/C++
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
gpt4all
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.