While this may sound scary at first, I suspect it could mature, with people finding the appropriate social norms around this new technology, and slowly integrating into their daily lives. In this sense it could resemble the social network or the mobile phone, where even luddites eventually cave in, as it eventually becomes a no-brainer, benefits greatly outweighing drawbacks.
That said, there is still a long way to go and this technology still has not found a compelling application. The only reason I would consider using it is to be one of the first people to actually figure it out on the ground and potentially find those compelling uses, if they exist.