Weird that it would be a boon for both forensic accountants and fraudsters. How do you reconcile that sentence?
The fact that something is done in public does not mean that it is centralized. There is public and decentralized, public and centralized, private and centralized, and private and decentralized.
Decentralization itself, is a spectrum and not a binary quality. Just as, I assume, public / private also falls on some sort of spectrum spanning from everyone in the world being able to see to VISA/Mastercard corporate privacy policy to national intelligence agencies to group or individual privacy.
It is completely possible to conduct transactions privately on blockchains. Monero and z-cash (using zero knowledge proofs) are the best examples of this.
The biggest blockchains choose not to either due to legacy design choices (zero knowledge systems are a recent innovation) or the benefits of openness. For example, public transaction history allows for development of an on-chain reputation for a pseudo-anonymous account. It's also quite useful for managing decentralized organizations, as the treasury and spending records is meant to be public to keep the DAO accountable to its members and prospective members.
With the recent introduction of zk rollups on Ethereum, it's now possible to have the best of both worlds, in my opinion (see https://aztec.network/index.html). Transactions that need to be private will be conducted on zero-knowledge rollups built for privacy. Mastercard is working on this with Consensys for Ethereum (https://www.coindesk.com/business/2021/12/16/consensys-colla...).