Putting the privacy aspect aside, this is gonna be hilarious with people "abusing" Alexa for jokes etc. As far as I now, Alexa can't be restricted to the voice of a single/some people.