It's been some time since I lend books from the library that I had to pay late fees. But in university I had to lend many books, sometimes just for an initial literature scan only to return most of them and keep a few long-term. (Or ideally buy them through other channels eventually) I remember one book was very late and I had to pay fees far higher than the original book price. And the only reason was because the lending management was bad (=had a terrible UX) so I didn't know it was due. That was not ideal, as a student you usually don't have much money.
But I think damaged books are usually those that are used frequently. Rare and expensive books tend to be in great shape, even if they are lend out all the time. You just need to register in time for the next available extension slot. Also expensive/rare books are less frequently for take home available.