There's the rub. For the most part you'll never know, unless it reached epidemic proportions.
"Sorry the apartment's gone" - Google told me you had financial problems 15 years ago.
"" (silence) - We infer from the internet you're gay so won't be offering you a job interview. It's illegal discrimination but can't be proven.
The effects of losing privacy in the scenarios you list are mostly invisible. The chilling effect on having legal but fringe or unpopular views has already been demonstrated.
So there is a downside for many. They just don't realise it.