The other end where it hurts is your ability to take risk. If someone low balls you on a job offer, and you're flat broke, you don't have any runway to find a better offer. You also can't take a short-term mortgage (tends to be lower at the front of the curve) and will probably have to lock in a higher, longer term. You can't hold a lot of investments because you'll end up having to liquidate them at a cost. So you keep your money in cash or cash-like instruments and inflation eats a bit, too.
"It's expensive to be poor" is actually a well known saying for good reasons.