It’s two different effects. First being within a range is not the same as being at the center of the range. Someone 4% above average height should have ~50% of their dimensions larger than that. Similarly someone at 4% below average should have around 50% of their dimensions below that. At best someone in the exact middle of the range only has so much buffer to work with.

Second the correlation is less significant than your assuming. My legs are the same length as some people a full foot shorter than I am.