Something I noticed after migrating to oh-my-zsh while still on a spinning drive - if you're on a mac and clear out your system logfiles (rm /private/var/log/asl/*.asl), prompts begin to appear almost instantly even with ZSH.

I have no idea what is happening to cause this, but the performance difference is unmistakable.