True, but that doesn't really negate the hypothesis. What are those rules? Are they the same as the ones generated by a neural network? Or are they qualitatively different?
(Diagnostic experiment: Is there a significant subset of "cups" that a naive neural network would always fail to include or only include when also including a significant subset of non-"cups"?)