Obviously VR is the hope but I think we're pretty split on whether we want that. I can't really see Google Glass type thing replacing the iphone. There's some intresting stuff in this microsoft future of computing video about surfaces and glass, but It doesn't feel like one revolutionary consumer leap to get there:
Microsoft’s platform has never been weaker. For all the growth in phones, every professional worker on the planet is sitting in front of a PC.
Or a Mac, or a Chromebook, or an iPad. It's hard to talk about this as a monolith since there are pretty distinct groups — most of the people I know who get to choose their device are using Mac or Linux (which is admittedly an atypical crowd of developers, scientists, lawyers, architects, etc.) but there are a ton of people who have professional jobs where that's not the case (e.g. everyone I know who works in healthcare uses some kind of Windows device which is so locked down that it might as well be an iPad, and I know some people at government agencies who are favoring ChromeOS for security reasons since you can lock those devices down so hard).
I make that distinction because it doesn't help Microsoft very much strategically if the cashier at McDonald's is sitting in front of a Windows box because they're interacting with a single application and will use whatever their next employer has standardized on when, say, they go somewhere which uses Square. Someone who uses Office is a bit more but as an increasing percentage of people aren't doing anything which they couldn't do in a browser, that's not as strong as it used to be. None of that means that Microsoft is going away but I think it does leave them really wondering how to avoid falling behind the next trend like they did with mobile devices.
Humane (some ex-iPhone people) is working on some sort of projection like UI, but they have put out very little detail about it.
Apple is working on some sort of AR related heads up display. If the hardware can work well for that, the benefits there seem obvious if you can get the UX right. Looking at the world and pulling up information in your visual field would be really useful. Could still pull up flat 'screens' in your visual field for normal text/web interaction.
It's hard to do well given latency issues (need very low) and no real ability to draw black (AR uses ambient light), but if it can be pulled off I'd expect that as the next platform/device shift.
Paper's never going to be replaced but I have definitely wished countless times for something that could copy a paper for storage instantaneously.
(Given Wacom's technology with cintiqs, I'm actually surprised this isn't a thing already.)
The reMarkable is probably close to what you're describing. People who use them love them, but I'm still a fan of real paper and ink.
The reMarkable was supposed to replace notebooks, but I gave up on my reMarkable 2 after a month.
WWDC sessions https://developer.apple.com/wwdc22/sessions/ https://developer.apple.com/wwdc22/sessions/ https://developer.apple.com/videos/wwdc2020/
Apple has a patent for a tunable and foveated lens systems allowing it to accomodate glasses, contact lenses etc.
https://appleinsider.com/articles/22/01/11/apple-glass-could...
Everybody working in the AR field now is starting too early. In 2003 the iPhone was impossible, while by 2007 it was inevitable.
In 2010-2019 it was rarely above 20 and it even went below 10. The decade average was 15.
The large environmental devices would be 100% securely sharable and be in private homes, hotels, offices, metro stations, etc. With either my Watch or iPhone, no matter where I am, if I need to, I would have my work life, entertainment life, etc. at my fingertips.
iPadOS 16 beta has StageManager that is sort-of OK for providing a more general desktop environment. I would expect my Watch or iPhone to trigger whatever I need in my environment.
I get so tired of being "sys admin" for my digital devices. I want to spend as close to zero time doing this as possible. Similarly, my Dad is having his 101 year old birthday next month and although he has always been very good with computers, it is frustrating trying to help him remotely. So:
In addition to what I mentioned above, I would like to have VR/AR for quick telepresence to help him and other family members who might be 100s of miles away physically.
I don't think we should put too much thought (as the article seems to) into their quarter-to-quarter results in the Land of Lost Devices. The point there isn't to sell lots of devices, it is to either try new ideas (which will probably fail because we only get like one big new device class per generation) and have a foundation to quickly try and catch up if their competition finds the Next Thing.
https://www.macrumors.com/2022/06/06/apple-announces-multi-d...
This is why companies are trying to break into it. Hardware is the main gap at the moment but Apple is the best hardware manufacturer in the world. The M chips are a step in this direction (high performance, low power).
I imagine you will still use the internet in AR, otherwise how will you get information? What you probably meant is a web browser on desktops and phones.
100% but Apple always follows others leads and then makes a better product. Right now AR/VR leans heavily into gaming as for the audience is already built in. AR has so many applications I think eventually it will destroy the VR market usability wise. Im just saying for Apple it stands a better chance than their car efforts.
In the case of VR/AR, we know Apple has been working on VR products since at least the early 90s but those never made it very far other than a few things like QuickTime VR. As we can see from the rest of the field it was only until the last half-decade that people were getting things like the visual quality or especially latency to acceptable levels and battery life / weight still seem to be a substantial problem.
If you look at the numbers for VRChat it shows there is a market outside gaming.
AR is more complicated: there are some neat ideas but the form-factors are brutal in terms of hardware design and there is weak consumer demand. Apple has one of the most popular AR products now (AirPods) but that took a while to mitigate the compromises forced by the physical limits. I'm expecting some additional hardware from them soonish based on the references in recent developer builds but will not be at all surprised if that takes a while to find popular adoption. I think it's easy to underestimate just how hard it is to deliver an application which is compelling enough to get people to pay non-trivial amounts for. VR has been educational in that regard going from something which was too hard / expensive to fairly available but not yet having found mainstream demand.