Bayesian-Neural-network

A small project for Bayesian Neural network(Pytorch implementation)

slide

Partial BNN (update 5/10/2021)

Instead of having all weight distribution, only part of the weights are distributed, for example, last few layers are weight distributed. Reference: CSC 2516: Partial Bayesian Neural Networks

Papers

• Mostly important: weight uncertainty of Neural network
• Survey: Hands-on Bayesian Neural Networks -- a Tutorial for Deep Learning Users

Codes and contents are heavily inspired by

• https://github.com/cpark321/uncertainty-deep-learning several methods for BNN

• https://joshfeldman.net/WeightUncertainty/

• http://krasserm.github.io/2019/03/14/bayesian-neural-networks/

Other code or tutorials

• Blitz - Bayesian Layers in Torch Zoo

• https://github.com/krasserm/bayesian-machine-learning

• Pytorch implementations for several approximate inference methods

• https://github.com/nitarshan/bayes-by-backprop/blob/master/Weight%20Uncertainty%20in%20Neural%20Networks.ipynb

• https://paperswithcode.com/paper/weight-uncertainty-in-neural-networks

• https://github.com/anassinator/bnn

• torchbnn a lightweight repository of bayesian neural network for PyTorch.(But I have a doubt with his implementation)

• https://github.com/magister-informatica-uach/INFO320 A class for BNN and VAE