> do we expect that group of people to be able to easily afford housing in a good economy?

Yes. Of course we do. Housing is a basic human need (without which, you are homeless by definition). We should expect all people to easily afford housing in all economies, at all times.

We should expect housing to be as affordable as water or food or electricity is, at all times, in all economic conditions. It should never be "tough" for anyone to afford housing.