Google does allow you to delete some stored data. They don't offer easy options to delete everything (though they do give advice on how to remove information from third-party sites), but it's better than nothing.
https://www.google.com/dashboard
They also tell you what cannot be removed through the dashboard, and give a list of things that are not deletable (but also not tied to your account).