> And I am struggling to see any UI design/consideration that was new in this clip. Do you have a rundown on exactly what was amazing?
The State of the Union video has more detail. All of SwiftUI and UIKit now sits on top of their material-based renderer. You can now render a Metal Shader on a SwiftUI view in one line of code. They have consistent and detailed paradigms for how menus, toolbars, productivity apps etc should work on this platform (likely from porting all of their own). 3D models fit seamlessly into the UI view hierarchy. They have detailed design and interaction constraints for all new types of spatial windows, as well as legacy apps. All of this even goes back to their Objective-C APIs, which are updated appropriately
Then they've implemented things like process isolation for eye-gaze tracking. Simply so apps can't read your gaze and abuse that data. No one else makes decisions like this in a v1 product. It probably required a whole team of people to get right, considering that gaze is the primary interaction method a user will be using with your app
It's hard to explain just how much depth of thought has been put into this platform. They have addressed a lot of hard questions with some very good design, and above all, they are opinionated about their platform. In every corner and detail there is a strong design choice about the right way to design and implement that interaction. That opinionated design is why people get so excited, and it can be so jarring when they get it wrong