The public absolutlely paid the price in the form of bailouts. If those banks had been allowed to fail I would agree with you, but they knew they'd probably be bailed out from the beginning and used CDOs to ensure it.

QE is a direct transfer of wealth from dollar holders to investors and banks. No way around that.