Yeah, I wish this was more normal to aim for, "It depends". Everyone is always trying to come up with a silver bullet that works for everything, and once they find something that works for them, they try to shove it down everyone's throat.
Same happened when "open floor offices" gained popularity, the cargo culting began and now you're a bad company unless you have a open floor office. Same is happening with remote work.
As someone who mostly does frontend, I need to be able to work tightly with product and design teams, to communicate and ask questions during implementation.
But back when I did backend work, I could mostly just receive requirements from product and frontend team, spend time in isolation to fulfill those requirements and my work was done (most of the time at least, not always).