Founders are also incentivized to invest much more time energy into their businesses than a middle manager.
Founders also shape their org structure to something that suits them, while a middle manager has to work within the constraints of their organization, which are often stifling with significant overhead.
Even basic things take inordinate amounts of time for middle managers. You could ignore them, but that often has secondary impacts like not taking care of your team (promotions, good reviews, training, etc.) or not getting your team the visibility it needs.