#170 · Primary category: MLOps & Evaluation

popmon

covariate-shift data-analysis data-distributions data-profiling data-science dataset-shifts drift-detection hacktoberfest ing-bank ipython jupyter mlops monitoring pandas population-monitoring python spark statistical-process-control statistical-tests statistics

Monitor the stability of a Pandas or Spark dataframe ⚙︎

Project last updated:01/09/26

GitHub Stars

511

Forks

35

Contributors

20

License

MIT

Why we included this project

Most drift-detection tools expect you to stand up an entire monitoring stack before you learn anything useful. popmon takes the opposite route: it runs on existing pandas or Spark dataframes, buckets feature values over time, computes histograms, and applies statistical tests to catch trends, shifts, peaks, or correlations that have changed. The output is a self-contained HTML report, so findings are easy to share or file away. Because the same logic works on a local dataframe and a distributed one, teams can prototype checks in a notebook and reuse them on cluster pipelines. You can also set business rules to flag problems automatically and ship histogram data to Grafana or Kibana if your team already lives in those dashboards.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category