I think trying to shovel computing power into the "display" is a terrible idea. There are already supercomputers in our touch devices, on our laps, and in the cloud.

Just make bridge cooperation between touch device, laptop, and display/XR with faster nearfield links to remove HDMI and such. And make it a standardized open ecosystem that casts between each.

Quest has all of the right sensors, but it locks away too much expensive computing power for a single dedicated purpose. It's extremely convenient but it's also another device to MDM and separate from a users other apps.