My issues in general which lead me to locking down the permissions, and not really looking back, is that its frustrating to work with. If I'm trying to text hands free in my car it has random delays that have no audio cue to work with. If I'm holding the phone, I can feel its vibrations telling me when its ready... but I'm driving, so handling the phone itself seems like a poor choice.
After that I tried some things like "Ok Google, when I get home remind me to put the trash out"... to which point it launches a calendar app and requires me to manually press things... or mishears me and just tries googling for random shit. Again, not helpful while driving.
I tried playing with it. I had my navigation open while commuting in an unfamiliar corner of the country once and I said: "Ok Google, I need to use the bathroom"... so it google searched constipation cures.
For the record, the permission it wants me to enable is Web & App Activity Tracking... which should not block me from voice texting but here we are.
---
Nitpickiness aside, it just isn't that special anymore is it? I don't see what's so special about a niche, buggy voice prompt that requires me to run apps manually half the time. Its a nice feature to include, but it has never felt like a "selling point" to the phone lines.