If a person can add to a culture, then a person could also subtract from a culture. Getting the wrong people on the bus can be very damaging to a company. This is not to say that companies always do a good job at selecting people for addition rather than subtraction.
Any place that could be deemed a "brotopia" is likely bad at building positive culture--I know I wouldn't want to work there. But still, different people will have different effects, some of them being net positive and others net negative. And what counts as positive or negative will vary a bit from org to org. If you can call culture fit a "culture addition", a lack of culture fit may be a case of "culture subtraction".