Or the banks will just raise the profit margins.
A bank doesn't operate alone in a vacuum. As the number of people who have prime credit shrinks the competition to lend to those people will go up. They can't simply raise profit margins because there is always another lender out there who will be happy to take on a prime credit borrower.