Sure, but they have to give you your money back. They can't just keep the money.
In other words, you leave the bank-branch with a big sack of cash... And then your car is impounded because you can't prove you're the owner or your license expires, and you'll live in a tent in the woods because landlords can't verify your credit/rental history, etc.