A Visual Exploration of Gaussian Processes

The article focused on the case where you have a finite number of test points, which is probably a good idea for an article like this. Still, there is another interpretation of Gaussian processes where they are actual stochastic processes (hence the name), a probability distribution over a set of functions.

I would have found an article that covered that interpretation even more helpful, although I'm not sure an easy-to-follow version could exist.

In particular, there's a kernel we could call a "change point," which is a way to have a totally different model fitted before a point in time versus after. It's used frequently in Automatic Statistician fitted models (https://automaticstatistician.com/examples/) which in my opinion are the state of the art of what you can use GPs for. They also developed a "LISP" like representation of the GP kernels, which lets them sample functions, fit them, and publish the simplest ones.

You can see an example of, "Create GP functions and try fitting them" here: https://github.com/probcomp/notebook/blob/master/tutorials/e... . Near the end of the notebook, you can see the "source code" of the fitted GP function. Note this implementation supports change points, but does not happen to need them on the sample data.

But generally, I wonder in which applications GP shines.

On the one hand, with its emphasis on time series data, GP has a lot to offer to finance, especially options pricing. On the other hand, GP boils down to "the near future looks a lot like the near past," which most people already know.

Clearly, what we want to know is: when will change points occur? Whoever cracks that nut has found GP its breakthrough application.

It should be clear from the example that some form of fitting over the generation of "Gaussian Process Programs" is a good first step.

https://planspace.org/20181226-gaussian_processes_are_not_so...

Would love to get more feedback as well!

Shouldn't it be the mode?