It will only be an issue for people who watch it...
I'm heavily against the license fee, as the majority of content could be delivered commercially. I absolutely hate that i'm paying money towards soaps, cake shows, misses brown boys etc which I will never have an interest watching and get zero value from.
The small amount of state or non commercial stuff it produces could be paid for by tax or a much smaller license fee.
The money i save could be spent a couple of books or rentals instead which I would get value from.
I find the argument for purely commercial a selfish one as public broadcasting provides a lot of public good through educational means. I mean, just tune into The One Show or Spring Watch on an an evening and you'll get what I mean. Plus no ads!
That's as about as selfish of not wanting to pay for a gym membership i don't use.