Google has (wisely) made this feature opt-in, rather than opt-out, so I suspect that should solve most of these types of concerns.