Agreed, and in my opinion, Apple messed up with the Vision Pro with this. They took the battery and made it external, yet the head unit itself is heavier than most battery-included head units! IMO they should have made the compute unit external as well (you already have to have a brick attached via a cable, it's madness not to (technical details aside, potential added latency, etc)). I don't really know the details and I'm sure someone has weighed all the components...but if the processing was not in the head unit, they ditched the external facing display + glass screen cover, and went all in on being light weight (maybe a carbon frame vs aluminum? not sure how much that would save), it would be much more enjoyable.
Obviously the Vision Pro in a glasses format isn't possible now. However, the Vision Pro with a few hundred grams shaved off of it, plus being a little bit less "horizontally" bulky would result in a much more enjoyable user experience.