I think any potential benefit for having an AI assistant would immediately be offset by the problems, scale, and impact the collection of that data would engender on your life.

Its a short step from a simple assistant to having a spy that watches you every hour of every day, and may not just watch but also interfere in non-alerting ways.

What happens when the company monetizes without proper disclosure where it develops a model of you, and then alert the authority when you deviate from said model for enhanced surveillance or harassment. Government would be a guaranteed customer. Dictators and other authoritarians would love it. China already does a lot of this with their social credit framework.

Free speech, that's gone. Privacy, gone. Future gone. The perverse incentives that inevitably lead to exploitation and enslavement over time are pretty horrifying.

Its the shortest of steps to Orwell.