Yes, I understand what government subsidies are and how they work. But if I'm not the one subsidising the product then I don't understand how me benefiting from that is a bad thing for me personally.

The US subsidises gasoline quite aggressively when compared to other countries around the world. You can see this in fuel costs; routinely US gasoline used to be cheaper by the gallon than Australian gasoline was by the litre. I've never once heard an American complain that their fuel is too cheap despite the fact that their taxes and government are directly responsible for said low cost.