I'm not sure what the current state of the WordPress world is, but I know that without caching you were bound to crumble under any kind of traffic spike not very long ago.

Perhaps that's a good first step (I'm sorry I don't know which of the caching plugins is best, WP SuperCache used to be the one to use 'back in the day')