At the office, it was nice to see him put the glasses down and shake hands with the person who rocked up. If that person had arrived 'in VR' I think I would have been completely turned off.
I guess if you want to be alone, it's a good device -- but the best times for me with modern technology have been when it brings me closer to other people. Online games were better on LAN. Couch co-op as a genre is one of the best console experiences I think. Meeting people in real life, who I spoke to on IRC -- again, a great moment.
I'm not anti-tech, and the device form factor sure looks amazing -- but I can't imagine any moment I would use something like this at home while anyone else in my house was here.