I don't think anyone takes the decision of pulling the parachute lightly, but in many cases it is statistically the best path to take (there have been no fatalities through proper use of the parachute). If pilots had been using the parachute in cases where it is not necessary, insurance premiums etc. would reflect this but this has not been the case. I think the main debate is to the risk of injuring someone on the ground. Thankfully this has not happened yet, but it should be the duty of pilots to put the safety of others ahead of themselves.
In other words, maybe you could have recovered from their "departure from controlled flight", but maybe they can't; and since there is a safety mechanism to recover them, that becomes OK (instead of a fatality statistic).