I found prezto did too many things (replaced mkdir, cp, rm and ls with slightly incompatible wrappers for example). The worst was wrapping diff and make, both of which broke scripts I used.

oh-my-zsh seems from my experience to be less eager to replace built-in functionality (although, I'm not an expert in either).