Knowing the address of three strangers isn't very valuable, and thus less likely to be abused. Knowing the address of millions of people can be very valuable, and thus very likely to be abused.

In cases like this the issue lies not in the specific datatypes, but the aggregation thereof.