I'm certain neanderthals were just calmer, more empathetic. And then we came along and abused that until they were all gone.
We're still animals on this planet. We just sing about our conquests afterwards.
I'm arguing that the egalatarian 'lift my lamp beside the golden door' society is a cheat code for producing the variety and ferment that makes everybody frustrated and unhappy but producing with wild abandon. As a society this tactic dominates the hell out of would-be ethnostates and dictatorships, which seems to also be a natural tendency of humans. They are interested in not being challenged, in those like them not being challenged. Comfortable for those fortunate individuals, hopelessly suboptimal for the society they're in.
The rallying cry of 'NO New York Cities! Only sundown towns where if you don't look right you are killed and nobody ever knows about it!' might please some people (who have never been anywhere near those evil cities) but it just goes to show that many people have unhealthy wishes that are bad for them and the societies they're in.