#218 · Primary category： Inference & Local Deploy
pinferencia
Python + Inference - Model Deployment library in Python. Simplest model inference server ever.
Project last updated：02/14/23
GitHub Stars
543
Forks
83
Contributors
4
License
Apache-2.0
Why we included this project
Pinferencia is a small Python library that turns a trained model into a REST API and a clean web GUI with only a few lines of code. It serves anything from a plain function to a PyTorch, TensorFlow, or Hugging Face pipeline, so you can prototype locally and then move to Kubeflow, Triton, or TorchServe later thanks to its Kserve-compatible API. That compatibility is the practical part: you get a lightweight way to demo or run small internal deployments without committing to a heavy serving stack. It is not a full platform, more of a fast on-ramp, which suits teams that want a readable path from notebook to endpoint.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
ollama
Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
llama.cpp
LLM inference in C/C++
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
gpt4all
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.