#156 · Primary category: MLOps & Evaluation
Deep-Learning-in-Production
In this repository, I will share some useful notes and references about deploying deep learning-based models in production.
Project last updated:11/09/24
GitHub Stars
4.4K
Forks
685
Contributors
3
License
Other
Why we included this project
When you've trained a model and need to get it out of the notebook and into a running service, this repository is a shortcut through the usual confusion. The author has sorted references by the steps teams actually take: converting PyTorch models, moving them to C++ or browser runtimes, and building REST APIs with Flask or TorchServe. Each link gets a short note, so you can quickly tell official docs from community posts that are worth reading. The collection also covers serving options like ONNX, TensorFlow Serving, LibTorch, and serverless functions, which is useful if you're deciding between them for an internal project. It's a reading guide, not a deployable framework, so you get pointed at working code examples without a runtime to maintain.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
unsloth
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, FLUX and more.
LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
langfuse
🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
netron
Visualizer for neural network, deep learning and machine learning models