People vary. I find it quite difficult to work effectively in an open office. Coffee shops are often better but not that great. I find either total silence or soft instrumental music is usually best for me. Some people seem to enjoy open offices although I suspect their work is different and does not require the same level of deep concentration.

The obvious solution is to allow people to select the office environment that works best for them: office, cubicle, open area etc. instead of imposing a one size fits all "solution" from above.