I think you could probe into some truth about it by looking at the volumes being traded on exchanges and how much are in the exchange's wallets.
Fiat money derives its value from what you say, indeed. It is traded on exchanges because of that. But fungibility is only one of several factors. Money should also serve as store of value, but how long is highly debatable and the point.