#156 · Primary category: MLOps & Evaluation

Deep-Learning-in-Production

angularjs c-plus-plus caffe2 convert-pytorch-models deep-learning deep-neural-networks flask keras model-serving mxnet production python pytorch react rest-api serving serving-pytorch-models tensorflow-models tesnorflow tutorial

In this repository, I will share some useful notes and references about deploying deep learning-based models in production.

Project last updated:11/09/24

GitHub Stars

4.4K

Forks

685

Contributors

3

License

Other

Why we included this project

When you've trained a model and need to get it out of the notebook and into a running service, this repository is a shortcut through the usual confusion. The author has sorted references by the steps teams actually take: converting PyTorch models, moving them to C++ or browser runtimes, and building REST APIs with Flask or TorchServe. Each link gets a short note, so you can quickly tell official docs from community posts that are worth reading. The collection also covers serving options like ONNX, TensorFlow Serving, LibTorch, and serverless functions, which is useful if you're deciding between them for an internal project. It's a reading guide, not a deployable framework, so you get pointed at working code examples without a runtime to maintain.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category