BNNs

Challenges in Markov chain Monte Carlo for Bayesian neural networks

Markov chain Monte Carlo (MCMC) methods have not been broadly adopted in Bayesian neural networks (BNNs). This paper initially reviews the main challenges in sampling from the parameter posterior of a neural network via MCMC. Such challenges …

Wide neural networks with bottlenecks are deep Gaussian processes

There has recently been much work on the 'wide limit' of neural networks, where Bayesian neural networks (BNNs) are shown to converge to a Gaussian process (GP) as all hidden layers are sent to infinite width. However, these results do not apply to …