The original poster means: given that you have paid all your taxes, etc, the marginal cost for you of going to the library and taking out a book is 0.

Of course the infrastructure costs money to maintain, and the people working there are paid.