Here are your choices: a 800k house that require you to work 18 taco bell/gas station/home depot shifts per day OR out in the boonies where if you want insurance you need to work 5 shifts per day. Both are impossible, so you just work 3 shifts and don't have insurance and use food stamps to eat.
There stories are not well distributed but people that get priced out of cities end up buying a singlewide/double wide or just rent and then the house gets destroyed and they have no insurance and end up entirely on the streets.
So yes it is definitely insensitive to say that. Perhaps you would understand if your cushy tech job was 25k per year instead of 225k.