Author here, thanks for the comment!

While this is an interesting read (and NTMs are great), it is not particularly relevant to the model I describe or this paper.

I think you are misunderstanding my generality of my paper: I am not discussing a particular method of deep learning. I am using the idea of gradient descent as an metaphor for the field of AI, itself.

As described in the second paragraph of the "Gradient Descent" section, this analogy is not high dimensional. In fact, it is only three dimensional: distance the field is from General AI, time, and a hypothetical "method of attack".