I think a common “solution” is to use a Gaussian process model.