Of course I can't claim that my personal experience is representative of all people. But you're the first person I hear say that did not feel any psychological effects of doing a PhD.
Every single person I know that did a PhD (including myself) has mentioned feeling frustrated/isolated/depressed/etc at different stages in their PhDs. It is interesting to see that some people are actually not affected that much.