> Also this appears to have been written in 2012. It has nothing to do with modern AI (which I assume is why it was posted today).

Given that it is written by Scott Alexander, it probably was in fact about AI, if not necessarily neural networks per se. (Specifically, about the problems with 'oracle AI' or 'tool AI'.)