What I do to avoid this is whenever I read a book I put a little dash in the margin next to anything that's worth remembering, and then after I finish the book I copy down all these sentences into a mindmap. The means that I've read all the insightful/informative parts at least twice, typed them once, and then have them in a format that makes it really easy to refer back to them.