Slow front-end templating is definitely a major problem for many WordPress installs. Varnish can work some magic, as can a little Cloudflare, but agreed: WP performance must be engineered.
Varnish does go a long way, on the HTTP side combining and minifying scripts helps a lot too. I think the heavy load is almost the nature of the system, but there are some ways to alleviate the pain!