Of course not, but phrasing it in this way (that phones are a separate exception) minimizes the legitimate critiques of always-listening cellphone privacy.
Phones solve many more problems though.
I'm willing to make some sacrifice so that I can get GPS/maps anywhere I go, ability to make emergency phone calls, etc.
Smart speakers really don't have the same value add.
Apparently on this site it does. I had a conversation where I made a joke about Alexa glasses spying on us all in public instead of just in the privacy of people's homes now and got downvoted to oblivion because apparently you aren't allowed to care about privacy if you own a phone. The amount of whataboutisms on this site where people try to invalidate others opinions or critiques is incredible and makes it very difficult to have any kind of genuine discussion. I imagine it's partially because there are plenty of Google/Facebook/Amazon employees on this site so it's in their best interest to shut down any pro-privacy discussion