Perhaps it's because there is only so much expression in our genetics. Don't think of it as if you lost something. Think of it as if you are investing and building up in the areas with max rio. By max rio I mean it on all levels of genome. Individual, your family & our society. I also believe the results can compound over time.
As a side note, I was raised Roman Catholic. Although I have not gone to church since college I hear interesting sciency things now and then. One, which I don't have a citation for, is that nuns who are experienced at prayer exhibit similar fMRI results when they pray.