#684 · Primary category: Education & Research

Bayesian-Neural-Networks

approximate-inference bayes-by-backprop bayesian-inference bayesian-neural-networks classification deep-learning hmc kronecker-factored-approximation langevin-dynamics local-reparametrization-trick mc-dropout mcmc out-of-distribution-detection pytorch regression reproducible-research sgld uncertainty uncertainty-neural-networks variational-inference

Pytorch implementations of Bayes By Backprop, MC Dropout, SGLD, the Local Reparametrization Trick, KF-Laplace, SG-HMC and more

Project last updated:10/20/23

GitHub Stars

2.0K

Forks

306

Contributors

4

License

MIT

Why we included this project

Researchers and students learning how Bayesian uncertainty estimation works inside deep networks will find a lot to work with here. The repo implements the main approximate inference families in PyTorch: variational approaches such as Bayes by Backprop and the local reparameterisation trick, sampling methods like SGLD and Hamiltonian Monte Carlo, plus cheaper shortcuts such as MC dropout and the Kronecker-factored Laplace approximation. Since the same toy and UCI regression benchmarks and MNIST classification tasks are used across methods, you can compare how each one behaves without rebuilding the setup, and the Colab notebooks mean nothing needs to be installed locally. Teams that want calibrated confidence scores or out-of-distribution awareness in classifiers and regressors can treat these implementations as a starting point. The code stays close to the original papers, which makes it a genuinely useful way to work through the theory rather than just copying.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category