I don't think it's reasonable to represent our brains as similar to that of artificial neural networks. They don't work the same. And the metaphor ends up being unfair to both the human and the mathematical and engineering accomplishment of an ANN.
The main reason why I draw parallels is because my main objective is progress towards machines achieving human-level intelligence. We already have an "AGI" which works incredibly well; the human brain. We should be studying it as deeply as possible and borrowing its means & mechanisms for use in our machine intelligence systems. Trying to re-invent the brain from scratch is surely going to be far harder.