NNGPs

Wide neural networks with bottlenecks are deep Gaussian processes

There has recently been much work on the 'wide limit' of neural networks, where Bayesian neural networks (BNNs) are shown to converge to a Gaussian process (GP) as all hidden layers are sent to infinite width. However, these results do not apply to …