Don't know why you're downvoted, this is pretty much the crux of the story. Someone has to eat chargebacks and fraud costs.

It isn't going to be your payment provider that does so.