> given that it's quite plain it's an emergent property.

This explains nothing. Stating it's an emergent phenomenon gives us just as much information as saying it's magic. Arguably even less, because it sounds like an explanation, whereas "magic" doesn't pretend to explain anything.

> displaying emergent behaviours that couldn't have been predicted beforehand.

Same problem here. You say "couldn't have been predicted". Which is only true if you explain it away with emergence. The behaviours weren't predicted, because we don't understand how these networks work. Saying they couldn't have been predicted implies that we can't understand them. Which is a very bold statement and I'm fairly certain that it's not true.