Here's a fairly innocent scenario: if Amazon Echo can learn everything about you, they may discover that you're crazy about Paris and you have good income. Then they can sell this info to every travel website who'll put you into a pricing bucket which would guarantee that you'll overpay for your next trip.
But generally speaking, we take advantage of information asymmetry all the time: buying real estate, getting a new job, planning a vacation, etc. Sometimes you have the leverage, sometimes you don't. With massive information gathering by a handful of big players you'll most likely end up on the losing side in the future, especially when dealing with businesses/governments who can afford to buy a profile on you before engaging. Imagine if your religious beliefs and either you voted for Trump were available to anyone via an API call which takes your face image as the input and costs $0.02 to make.