I think a lot of people would say yes to that feeling. Reading is a mentally taxing activity and thats exactly why it is required. I'd say books are like a huge piece of argument for a stance and it really pays well to understand things deeply.

There are means of achieving reading without any reading too. Have you tried audio books? I haven't, my mind drifts too much in audio books, but some friends swear by them.