1. There is no window management whatsoever. It would be great if I could stick apps to each other, or tile them in a frame, but I can't do that. I also can't stack windows—if I put one window behind another, the only way to access it is to move the front window out of the way, or to close it. Kind of ridiculous, because I'm pretty sure that problem was already solved in the early 80s, if not ealier.
2. The field of view is really narrow. I have a 32:9 curved monitor, and I can easily look at the "side" apps by tilting my head just a few degrees, with my eyes doing the rest of the work. AVP demands tilting your head much more in either direction to see the window content, making it much harder to momentarily glance at.
3. I've had awful luck with the MacBook screen projection. Others may not have this issue. After a couple minutes of using it, it begins to heavily stutter to the point of being unusable. The keyboard handoff randomly disconnects. And AVP doesn't yet support bluetooth mice, only trackpads (either the MacBook's built-in trackpad, or a Magic Trackpad).
At least for normal desk work, AVP does not improve speed or efficiency in any way—it does the opposite. Hell, when I'm projecting my MacBook screen, I have to resist the temptation to just use desktop apps for everything, because they're so much faster and easier to use than the floating visionOS/iPadOS apps.
It's the iPad all over again. If you're a seasoned PC power user, using AVP will only hurt your efficiency in the same way that it would to try offloading some of your work to an iPad.
With that said, it does make certain things more enjoyable. Apple clearly didn't make this device as a solution to existing problems. The point is that it's a new relationship that we get to have with technology, which will possibly change the way we want to use technology.
But for real, Apple hasn't launched a first-gen product this limited in use since the original iPhone. It has a long way to go before it actually starts making digital life more efficient, except for some highly specialized use cases.