Yet if you have a smartphone you trust the manufacturer with running a microphone everywhere you go.
You can complain about banking system and be proponent of bitcoin while having a bank account and paying for goods with fiat currency.
Phones are in similar position. Assistant devices are not, they are usually in a fixed location with a unobstructed way to the environment.