This is insightful thank you. Question: if you work with a wide range of AR displays, what do you suggest that's readily available and has a sdk?
However, a secondhand Quest 3 with unity in MR is the cheapest way to get started. It gives you SLAM/world frame of reference, which almost no other system does (apart from hololens)