I think it's because most web developers don't ever have to understand how this stuff works. It's sometimes easier to just throw hardware at a problem than engineer it better. However, understanding what you can do is key imho.

Isn't the point that dynamic content is changing and you don't want to cache it? What would be a good cache time for HN for instance?