As a blanket advice, I really don't agree. It depends on what books, it depends what they're trying to teach you. Huge difference between a reference book and... pretty much any other kind of books.
Many times you don't want to know something, you just want to know something exists/is possible/has already been done. Skimming through books cover to cover is one way to do it.