I think in the 5-10 year time period, people who value using the phone as more of a productivity tool and dislike the distraction will have only a wearable and perhaps not even use a phone.
But those who like content consumption (probably most people) will still be walking around with a rectangle in 10 years, if I had to guess.