What if you sent a message through your app to each person who is revealing personal details about themselves, a) letting them know what's out there b) showing them how to fix it/offering an alternative. In case you are not able to do so directly, you may be able to reach these folks through the people who've installed your app. You could also have a public-facing presence that shows how many possibly privacy fiascos you've helped people notice/squash.
edit/ps: I'd be interested in collaborating, if you're interested in making a public-service app like that.