They can't charge late fees without minimum payments. What would be late exactly if a payment wasn't required?
I.e. regardless if there are late fees or not: you can't be delinquent on any debt, regardless of label, indefinitely. Also regardless if there are late fees or not: the amount you're delinquent will already increase exponentially more than just the sum of the minimum payments you missed because of interest.