He was decidedly not right. His claim was that neural networks are fundamentally not able to perform an XOR step, limiting any relevant computational capabilities. That claim was easily remedied later by slightly changing network architectures later on.