Everyone of us wants to feel significant, loved, and giving up on an idea that we live forever, that there's always someone external looking out for us etc is an emotionally difficult process to go through.
But that's what personal growth is. It doesn't mean that you go nuts and do crazy shit - consequences exist. What it means is that your perspective changes and you become OK with just being you, and taking a journey on a speeding rock through space.
People think that you lose when you give up religion, which is in part true - but there is also a lot to be gained - in personal development, seeing life from a different perspective and appreciating the limited time we have before donating our atoms back to the universe.