That's right. Banks would have to charge fees for the services they provide, or become more efficient, or both.
They certainly would become less of a profitable and shrink as a percentage of the economy. Which is good: smart folks would be incentivized to go into things like manufacturing and research, and produce actual value.