SICP is one of the books that I've seen everyone recommend - and I never understood what is so special about it, until I finally read it!

It feels very similar to a mathematical book. Rather than learning about the syntax, or the programming rules It teaches a way of thinking. I agree it is hard - but I don't know if it could be simpler.

In the end programming is not about computers or programs - but people solving problems. It teaches people to solve problems using computers.