Pingback can also include variable contents, so it's not just "they can get the IPs", but also potentially secrets and such.