I agree. Far more destruction happens in life, in our callousness with each other. The way we tear down each other's minds, piss in each other's homes.
Death is as natural as birth. But sadism, addiction, domination, waste... those are not natural. They are a force from another place, one many religions have a name for.
This does seem to be the point many religions try to make. That there are things in this world worse than death, worse than suffering. There are things which strip you of your nature, and many of them may even feel pleasant, tempting, satisfying as they wrap their hands around you.