I believe the elevation of each point relative to the center represents the distance that one would have to be from earth's centroid to experience the same gravitational acceleration (relative to some baseline, presumably an average).
So, if you're in a stronger-than-average gravity spot, you move away from the centre until you are experiencing the same gravitational force.