Not as annoying as the self involved people who go around talking into a plastic brick in public. Normally we only excuse schizophrenics of talking to inanimate objects.
There was a time when vision correcting glasses were considered very strange I would imagine, but they proved to be very useful and we become accustomed to seeing them. What will be fun, I think, is as others have postulated wearable tech becoming less apparent to the naked eye, so much so that the plastic brick will be considered odd, and that one would WEAR vision correcting lenses mounted in metal or plastic frames right on the face?!
You are certainly not being any safer. The act of engaging in a phone call is what is distracting, not holding a device. Don't kid yourself.
http://www.usnews.com/news/articles/2013/06/12/aaa-study-usi...
http://mentalhealth.about.com/library/sci/0701/blcellphone70...
http://www.alertdriving.com/home/fleet-alert-magazine/north-...
http://www.mindthesciencegap.org/2013/03/14/look-no-hands-is...
Further, nobody is talking about people who use these technologies in private, they are talking about people who are using them in public.