That is largely not the case at all. In fact charging such is explicitly legal but also regulated:
https://www.accc.gov.au/consumers/pricing/card-surcharges
The exception to that is American Express directly issued cards and American Express merchant contracts have had such terms at least in the past. Not sure if they still do.