You can take steps to lock down your smartphone and limit its ability to spy on you, since you only need it to hear what you're saying when you're using it as a phone. You can't do that with these smart home devices; an intrinsic part of their function is that they have to be always listening.