5% of the US population is unbanked. A "cashless" society would shut out a massive number of poor, undocumented, homeless, etc and make life even more difficult for them. It would also cause skyrocketing issues with burglary, mugging, etc.

Many porn actors have been blacklisted from the US banking system.

Conservatives got tired of losing US supreme court cases over censorship laws and regulations and shifted to enforcing their morals via the private banking system.

Ever notice that there's no law or regulation requiring banks provide even basic checking service to anyone who can establish a valid identity?

Going cashless cannot happen unless either the government starts providing essential (checking, savings, credit card, and home/personal/auto financing) services they are mandated to provide to everyone (which will never happen because the banking industry would lose a ton of control) or banks must be mandated to provide non-lending services to anyone and provide lending on an identity-blind basis (ie, only metrics may be used, none which identify the type of banking or business or employment or spending you do.)