> We usually assume that (a) the entire universe is computable and (b) even stronger than that, the entire universe is _learnable_, so we can just approximate everything using almost any function as long as we use neural networks and backpropagation, and have enough data.

I don't think the assumption is that strong. The assumption is rather that human learning is computable and therefore a machine equivalent of it should be too.