Incels mistakenly think that the bedroom is one of these places, and that they are entitled to an equal amount of sexual attention as some other man. Thus the "gatekeepers" language when there is no gate.
The social-scale concerns are totally appropriate when it comes to how we construct masculinity and what male attractiveness requires, and feminists are by and large interested in that conversation.