A fully fueled and loaded Saturn V weighs about 3,000,000 Kg, and has a payload of about 40,000 Kg to the moon.
So that means once you've put all the bits of the rocket together that collectively give you sufficient thrust to get you to the moon, you've only got about 1.3% left for actual payload.
S if earth's gravity had been ~1.3% stronger, then the weight of the "getting us there" bits of the rocket would have left no room for payload. Any more gravity, and we wouldn't even be getting to the moon.
Equally, if the earth's gravity had been 1.3% weaker, we could have doubled our payload to the moon (or done things way easier).
Contrast that with a Boeing 747 which has 50% of total mass as payload, and so is relatively insensitive to changes in gravity.