Having charges be very difficult to reverse is a protection to the user. Treat it like cash which you don’t need to carry a wallet around for.
Plenty of people complain about the delay in sending cash digitally. Or Paypal siding with a buyer and the seller having their cash pulled back automatically because the buyer lied and said they never got it. Or money being tied up for months as resolutions to disagreements are verified.
Either you accept a bunch of controls to reduce fraud (and all the complexity and delay that goes along with it) or you get instant, irreversible payment transfers.
Your choice.