I'm definitely more worried about a FB speaker than an Apple, Amazon, or Google one. In that specific order.
Nobody reads TOS.
Car analogy: leaving you car in a bad neighborhood, unlocked, key in the ignition, door open, with a "do not steal or we will send you a threatening letter demanding our car back" note.
I'd suggest you turn of all the personalization ads option they provided so that you can avoid to be precisely targeted
> When we do send information to a server, we protect your privacy by using anonymized rotating identifiers so that searches and locations can’t be traced to you personally.