#187 · Primary category: MLOps & Evaluation
robustness
Corruption and Perturbation Robustness (ICLR 2019)
Project last updated:08/24/22
GitHub Stars
1.2K
Forks
149
Contributors
6
License
Apache-2.0
Why we included this project
Anyone who has shipped an image classifier knows that clean validation accuracy rarely tells the full story; real-world inputs come with blur, noise, and weather effects that can wreck a model's confidence. This repository from the ICLR 2019 paper by Dan Hendrycks and Thomas Dietterich gives you the standard tools to measure that: ImageNet-C, ImageNet-P, and the CIFAR-C/P variants, plus the code and scoring rules for running them. Instead of judging a model only on clean images, you evaluate it across 15 common corruptions and perturbations that stress temporal stability, and get a reproducible mean Corruption Error or mean Flip Rate to compare. The maintained leaderboards show what real gains state-of-the-art methods achieve, so you can benchmark your own work against published baselines without guessing.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
unsloth
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, FLUX and more.
LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
langfuse
🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
netron
Visualizer for neural network, deep learning and machine learning models