You never want it to stand out, you just want everything to look balanced.
A slight amount of hanging looks like it's not hanging at all -- it just looks right. The same way the top and bottom of an 'O' are higher/lower than the top and bottom of an 'X', even though it doesn't look like it.
It's all about visual weight -- how the eye perceives it.
Fully hanging punctuation is just way overdoing it.