Do you have a smartphone in your pocket right now? What's the difference?
If you are scared about an Echo in your house then you should be keeping your phone, tablet, laptop and 50 other similar devices locked up in Faraday cages at all times.
This is not about escaping every slight chance someone might surveil you, which one can't do anything about anyways, but to make make sure you're at least not part of a dragnet effort powered through the blackbox computer provided by a hostile entity whose only purpose for existing is recording your voice.
Of course that's just an evolution of the same problem, but it's where we are right now.