yeah, we certainly have no examples of people moving to deserts on this planet, and even considering it a very attractive place to live :)
Mars with its -80 degC is much harsher desert than dirty industrial towns of Siberia.
I've watched a few documentaries and there are barely a handful of houses let's say in Death Valley. And Death Valley is a lot more hospitable than Mars.
To each their own, though, sure!