In my opinion, reading is more for shaping your thoughts over time. I generally don't read for recall value except for technical things, and even there, it's better to build a good mental model of the subject through a combination of reading and exercises, then use a book as a reference.

For non-technical books, I've very rarely seen any value in taking comprehensive notes (except highlights). I read those on a Kindle, so it's easy to highlight and reference highlights later.