Not sure I get your point, are you saying that I should enjoy them because many people do?
Conversely, if you said you don't know how you could possibly enjoy, say, the Plastic Ono band (Yoko Ono's band), then it would be harder to suggest it's even possible (not to say that enjoying them, for anyone who does, is in any way wrong!).
But again, you don't have to of course :-). But I agree that it feels more likely that you may end up enjoying quality music you don't like now than bad music you don't like now!