I have the same opinion and said the same thing in discussions with some friends. Being powerless is the element that needs to dealt with, by being homeless against your will for example.
I could imagine myself being homeless just because I choose to do so. I could also imagine that I'd live in a home and feel imprisoned by obligation. Between those two cases, I'd prefer self-chosen homelessness.