While Everest (8849m) is the highest point above Sea Level, Chimborazo (6267m) in Ecuador is further from the centre of the Earth (about 2000 metres further), due to the equatorial bulge. It's very measurable.
It is not about highest point from centre of Earth. That's is related to equatorial bulge but irrelevant to the discussion.