You are severely overestimating peoples desire to have something strapped to their face all day. And no, not "everything" will go this way. People in tech want it to go this way, but when you step outside the tech bubble, most people have no real uses for VR/AR outside of entertainment, which even then, isn't guaranteed to dominate that specific use case vs an unknown future innovation.
Neither myself, nor anybody else, has truly accurate insights into how humans will interact with tech in 100 years. Predicting the future is damn near impossible. I agree we probably will not be using the smartphone form, but I disagree that it will be replaced with something sprung from the current iterations of AR/VR. Again, id bet money on the adoption being similar to 3D TVs. Cool tech, not practical for mass adoption.