Why do we think that we need only one kind of workspace that meets all of our criteria? Can't we have an office with a variety of different workspaces that we can move between as our needs change?
https://dennisforbes.ca/index.php/2017/03/20/mindful-softwar...
-supporting exactly what you are saying. This notion that we each have a static workspace seems archaic, and an ideal world is one where people work in varied situations according to need: Sometimes privacy and quiet is ideal, and sometimes noise and chaos is invigorating. As much as the private office/anti-open plan thing appears on here, it's amazing how often tech workers love working in cafes, libraries, or accelerators that are like open plan offices to a few magnitudes.
This would require companies to invest in their people beyond "Here's your paycheck, here's your healthcare, be glad we're giving you this much". Granted, some companies do-and some probably do come with a variety of workspaces. I used to work at one, but I don't know how many people would answer in the affirmative if polled how commonplace they expect that sort of workplace to be.
From a business perspective its better to keep your high performers as long as you can - pay them what they are worth since someone else will any ways.
The open office plan could work with tall, fabric cubicles. My place now uses short, glass & aluminum ones. Not to mention people chit chat too much. I'm an EE and have to think about complex stuff; I can't think with the chit-chat; breaks my squelch.
Fortunately I have a lab I can retreat to. Thinking about moving in there permanently.
The creator of them came to regret his creation as they where subverted in a direction he never expected.
I've often wondered what a modern cubicle if designed today would look like, we've done wonders in computer modeling and such since even sound dampening designs would be much easier.