Oh yeah, I totally get that. I'm lucky enough that my team really averages less than an hour of meetings daily. Usually under 30min, most of that being a daily standup.
Our larger scoping/planning/brainstorming meetings are spread out enough that an hour-long planning call isn't that much of a burden, rarely more than once a sprint if even that frequent. We instead try to pre-plan or hash out things in threads and emails ahead of time, then use those as notes/outlines for a condensed call.
Far more common for us is an impromptu 15-20min discussion after standup to help unblock someone on the team, or a huddle when someone is stuck in the middle of the day. That fluidity feels more like the kind of casual interaction you'd get asking for help in-office.