> It's like saying - there's a trained neural net with input

It's not. There's a world of difference between a neural net and a chimpanzee. Chimpanzees are some our closest evolutionary relatives. They are living animals with whom we share a great deal of our DNA (98.8% seems to be an often quoted figure). Therefore, conclusions that are likely given the observation "neural net shows similar behavior to humans" are vastly different those given the observation "Chimpanzee shows similar behavior to humans".