MLOps & Evaluation

Experiment tracking, deployment, monitoring, and model evaluation.

187 projects

See methodology for ranking rules; order uses public GitHub metrics within this scenario.

161–180 of 187

Rank Project Stars Forks
161 sqlflow

Brings SQL and AI together.

5.2K 704
162 mlops-course

Learn how to design, develop, deploy and iterate on production-grade ML applications.

3.4K 599
163 pytorch-fid

Compute FID scores with PyTorch.

3.9K 528
164 sematic

An open-source ML pipeline development platform

1.0K 63
165 m2cgen

Transform ML models into a native code (Java, C, Python, Go, JavaScript, Visual Basic, C#, R, PowerShell, PHP, Dart, Haskell, Ruby, F#, Rust) with zero dependencies

3.0K 264
166 uptrain

UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

2.4K 205
167 projects

🪐 End-to-end NLP workflows from prototype to production

1.4K 473
168 MLOps

MLOps examples

2.1K 606
169 bert_score

BERT score for text generation

1.9K 240
170 pytorch-summary

Model summary in PyTorch similar to `model.summary()` in Keras

4.1K 409
171 OpenPipe

Turn expensive prompts into cheap fine-tuned models

2.8K 178
172 modelfox

ModelFox makes it easy to train, deploy, and monitor machine learning models.

1.5K 64
173 Auto-PyTorch

Automatic architecture search and hyperparameter optimization for PyTorch

2.5K 301
174 feathr

Feathr – A scalable, unified data and AI engineering platform for enterprise

1.9K 246
175 talos

Hyperparameter Experiments with TensorFlow and Keras

1.6K 266
176 ChatGLM-Finetuning

基于ChatGLM-6B、ChatGLM2-6B、ChatGLM3-6B模型,进行下游具体任务微调,涉及Freeze、Lora、P-tuning、全参微调等

2.8K 308
177 Safety-Prompts

Chinese safety prompts for evaluating and improving the safety of LLMs.

1.2K 89
178 simple-llm-finetuner

Simple UI for LLM Model Finetuning

2.1K 131
179 chatgpt-comparison-detection

Human ChatGPT Comparison Corpus (HC3), Detectors, and more! 🔥

1.4K 128
180 knockknock

🚪✊Knock Knock: Get notified when your training ends with only two additional lines of code

2.8K 225