The fundamental problem is there is no such thing as "human values". Lots of people think that their morals and philosophies are "universal", but they nearly never are. Just look at the impossible bind social media companies are in (clarification: I'm in no way excusing the abuses of social media companies, but even that thought means I think my definition of "abuses" is the right one) - one tribe thinks hate speech and misinformation is the cardinal sin, while the other thinks censorship and bias are the primary problems - there is simply no way to appease both sides for any particular piece of controversial content.

Take something more relevant to the dangers of AI. It could be an entirely rational belief that the vast majority of human procreation results in human suffering and despair (not to mention an order of magnitude greater suffering and despair for other organisms on Earth), so the only compassionate thing to do is to end that suffering - by euthanizing every human on Earth.

At least personally, that seems like a bad outcome to me. But I just make that point to show that our "human values" are not internally consistent. It's easy to read the writings of Aristotle (often considered one of humanity's greatest philosophers) and hear him argue that slavery is an absolutely just and rational outcome of war. "Human values" are all just a bunch of gray areas and judgment calls over which there is no consensus.