#150 · Primary category: MLOps & Evaluation
nannyml
nannyml: post-deployment data science in python
Project last updated:07/12/25
GitHub Stars
2.2K
Forks
192
Contributors
34
License
Apache-2.0
Why we included this project
Knowing whether a model still works after it goes live is often the trickiest part of MLOps, and NannyML targets that gap directly. It estimates performance when ground-truth labels are delayed or missing, using confidence-based methods, and combines that with univariate and multivariate drift detection so you can trace a silent failure to the specific input features that shifted. For tabular classifiers and regressors, you set a reference baseline from your test set, point the library at live data, and get charts that layer estimated metric trends, drift alerts, and ranked offenders in one view. That makes it a practical pick for data scientists and MLOps engineers who want to move past simple alerting to actually understanding why a model degraded. It stays model-agnostic and runs in plain Python notebooks.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
unsloth
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, FLUX and more.
LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
langfuse
🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
netron
Visualizer for neural network, deep learning and machine learning models