I am not sure, if I understand correctly, but it seems it is only an issue, if I am using a VPN?

Because without a VPN, I am naturally "leaking" my IP, as this is how the internet works?