I honestly don't blame the drivers. It's not just your house. Consider the number of packages they have to deliver and the cumulative amount of time this adds to their route. I've seen estimates that a typical residential driver delivers something like 150-200 packages per day. Even an extra 30 seconds per package adds up to over an hour of additional time to complete their route.

The incentive structure simply isn't set up to reward a delivery driver taking that extra effort. In fact, it explicitly punishes it.