On the other hand, I may have way fewer meetings than many others that might get invited to the same meetings, so I understand it can be hard to find a time where everyone is available.

I've only been to one company that had a sane meeting culture. Along with every meeting invitation there were attached documents that you were expected to read. You were expected to have notes and comments ready. The meetings mostly were not supposed to be a time where you worked vague things out.

Exactly. Make your own schedule, or others will make it for you.