It's weird, when I started using oh-my-zsh, everyone complained about its performance but it worked swiftly for me. Now after a year I can see the problem, even though I didn't change anything in the config. It's still acceptable on my desktop, but annoying to use on the server.