Yes, and when you do pay it's a lower "real" tax (due to inflation)
What you are doing by delaying taxes is hoping you have a lower rate later. Say you make less in retirement or die untaxed and your kids get a step up in basis. But without a change in rate (which might go up even), there’s no difference.
But yeah that's a second order effect. There aren't really any scenarios where you have a fixed nominal tax that can be deferred without locking up the money, so I think you're mostly right that it comes back to lower tax rate and step-up.