In software the material cost is not the cost of a concrete material such as wood (like you mentioned) but developer time
The other thing to bear in mind is that there is always more work to be done than time to do it. You have to factor in opportunity cost. As many other commenters have said, ultimately it's a balance which depends on your company's particular situation.
Thanks to version-control software it's also incredibly cheap to experiment freely with an existing code-base in a completely non-destructive fashion. I see no reason to treat existing code as fragile or precious.
Developing on a live fintech system is a different kettle of fish
Banks keep ledgers of transactions instead of just the balances, so that if an account balance is off, it can be recalculated from the transactions.
Transactions can be cancelled in case there was an error.
Invoices are often checked by humans before they are sent to customers, introducing an option to catch errors. If the customer receives a faulty invoice, they can contact whoever wrote it and ask for a correction. And so on.
Of course, there isn't room for error in every corner -- having a flaw in an authentication or authorization protocol could be very costly to recover from.
But in general, the assumption that in finance in general, there is no room for mistakes is simply false.
Then I can assume that all of your financial software has verification proofs and/or is fully model checked? If not, then clearly there is room for mistakes even in finance.