If you want people to end up all “being equal” to one another you will just end up on the farm, where all animals are equal but some are more equal than others.
Also, I think it quite amusing that you call what Fermi said “a strong claim” and a “moral judgement” and a few lines down you have the audacity to say that certain “ideas need to be discarded”. First of all, some of the “ideas” you talk about are indeed facts. And then who on earth do you think you are to tell other people what they may think of?