To be totally fair, I might get upset over a "library tax" that turned out to be actually funding community gardens. Those aren't even related ideas.
Maybe community garden is the wrong term for it. I would also be a bit unhappy if my taxes were paying for a library to feed the neighborhood. There's other/better ways for the government to give food to people from collected taxes.