Additionally, many (most?) feminists believe in "intersectionality", the belief that sexism, racism, classism, ableism, and heterosexism act in intersecting ways, and that all need to be dismantled together (for instance, this is why most feminists support reform of the US prison system, even though this is something that primarily effects men). Dismantling these oppressive systems would very much help those on the bottom.
The exclusive-focus-on-more-white-woman-as-CEOs brand of feminism is actually a minority of feminists (although they seem to get the most coverage in the popular press) and is widely critiqued within feminism.