I'm sure banks do use transactions, just not in a distributed system. It's hardly possible to use transactions when multiple entities are involved and you wouldn't want to anyway because you want a record of the failure, and that money actually moved.
I suspect they do use transactions when, for instance, inserting two rows in a double-entry register.