Dismissing an avenue of progress outright is to be defeatist or to sow defeat.
AI is going to use all this information against us. Because AI alignment can’t be better than people and corporations deploying the AI.
Lack of privacy is now a gaping security hole, being continually exploited on all our devices, across most sites on the internet.
[EDIT: And the leverage that information enables is being auctioned off to manipulators who we are exposed to continuously. This is just the beginning.]
We need to plug this security hole now, before power centralizes further and we can’t.