I mean, that's how taxes work. I don't have children, and yet I pay for schools. I barely ever drive anywhere, and yet I pay for roads.

As a society, we decide what we value, and then we pay for it. If you don't like what the group decides, it's your choice to move elsewhere.