IMO the real reason open floor plans persist is because it's cheaper for the company than the alternatives (cubicles, offices). The more people you can pack into work "pods" the better.
The reality though is that if employees are less productive, any savings in rent will be small compared to the costs associated with lower worker productivity (assuming you have expensive employees like engineers etc).