Your doubts are correct. They are not. They are worried about cryptocurrencies.
More fundamentally, they are worried about maintaining their status-quo power.
On the flip side, in a pandemic like situation, cash allows better off citizens to support their non-citizen friends fnancially from starving, while CBDC prevents citizens from doing that if the government chooses to control how the currency is used using technical mechanisms unique to CBDC.
Judging by the various voter disenfranchisement programs being pushed for, I would expect that dividing line between the eligible and the prevented to be somewhere between one group of citizens and another in some states, too.
I am not convinced governments should ever be trusted with deep and detailed control over what people do with personal levels of money, because we are a still a long way from the ideal of treating all people as created equal.
1. that all transactions are no longer left to the honesty of the tax filer to be taxable. There will be a paper trail for the authorities.