MLOps & Evaluation
Experiment tracking, deployment, monitoring, and model evaluation.
187 projects
See methodology for ranking rules; order uses public GitHub metrics within this scenario.
| Rank | Project | Stars | Forks | Updated | License |
|---|---|---|---|---|---|
| 161 |
sqlflow
Brings SQL and AI together. |
5.2K | 704 | 04/18/24 | Apache-2.0 |
| 162 |
mlops-course
Learn how to design, develop, deploy and iterate on production-grade ML applications. |
3.4K | 599 | 08/16/24 | MIT |
| 163 |
pytorch-fid
Compute FID scores with PyTorch. |
3.9K | 528 | 07/03/24 | Apache-2.0 |
| 164 |
sematic
An open-source ML pipeline development platform |
1.0K | 63 | 01/09/25 | Apache-2.0 |
| 165 |
m2cgen
Transform ML models into a native code (Java, C, Python, Go, JavaScript, Visual Basic, C#, R, PowerShell, PHP, Dart, Haskell, Ruby, F#, Rust) with zero dependencies |
3.0K | 264 | 08/03/24 | MIT |
| 166 |
uptrain
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them. |
2.4K | 205 | 08/18/24 | Apache-2.0 |
| 167 |
projects
🪐 End-to-end NLP workflows from prototype to production |
1.4K | 473 | 10/15/24 | MIT |
| 168 |
MLOps
MLOps examples |
2.1K | 606 | 08/02/24 | MIT |
| 169 |
bert_score
BERT score for text generation |
1.9K | 240 | 07/30/24 | MIT |
| 170 |
pytorch-summary
Model summary in PyTorch similar to `model.summary()` in Keras |
4.1K | 409 | 03/02/24 | MIT |
| 171 |
OpenPipe
Turn expensive prompts into cheap fine-tuned models |
2.8K | 178 | 05/25/24 | Apache-2.0 |
| 172 |
modelfox
ModelFox makes it easy to train, deploy, and monitor machine learning models. |
1.5K | 64 | 08/02/24 | Other |
| 173 |
Auto-PyTorch
Automatic architecture search and hyperparameter optimization for PyTorch |
2.5K | 301 | 04/09/24 | Apache-2.0 |
| 174 |
feathr
Feathr – A scalable, unified data and AI engineering platform for enterprise |
1.9K | 246 | 04/04/24 | Apache-2.0 |
| 175 |
talos
Hyperparameter Experiments with TensorFlow and Keras |
1.6K | 266 | 04/22/24 | MIT |
| 176 |
ChatGLM-Finetuning
基于ChatGLM-6B、ChatGLM2-6B、ChatGLM3-6B模型,进行下游具体任务微调,涉及Freeze、Lora、P-tuning、全参微调等 |
2.8K | 308 | 12/12/23 | Other |
| 177 |
Safety-Prompts
Chinese safety prompts for evaluating and improving the safety of LLMs. |
1.2K | 89 | 02/27/24 | Apache-2.0 |
| 178 |
simple-llm-finetuner
Simple UI for LLM Model Finetuning |
2.1K | 131 | 12/21/23 | MIT |
| 179 |
chatgpt-comparison-detection
Human ChatGPT Comparison Corpus (HC3), Detectors, and more! 🔥 |
1.4K | 128 | 12/01/23 | Other |
| 180 |
knockknock
🚪✊Knock Knock: Get notified when your training ends with only two additional lines of code |
2.8K | 225 | 06/23/23 | MIT |