We lived well without Google knowing everything we do, and I live well without almost any Google. I only have contact with Google on shitty-made websites, that for some reason I have to use. For everything Google does we have alternatives, and better ones than what Google is offering at that.
So yes, society would quickly feel the positive impact of Google no longer being.