Absolutely agree. It's probably the biggest disconnect I feel between how ideas are structured in my head and how to best communicate them in written format.
Parentheticals in English sit in this sort of midpoint between a modifying clause for necessary elaboration and a footnote/end-note for optional detail, and lots of people including me use parentheses where "inlining" the parentheses or moving them to a footnote would be more appropriate. That's in addition to conventional uses of parentheses, like to expand abbreviations.