There are some interesting connections between GPs and neural networks. Deep neural networks with random weights concentrate about gaussian processes, so the two may not be so far apart in practice.

https://arxiv.org/pdf/1711.00165.pdf