Absolutely, unquestionably, YES! (Certainly for some people). Those sufficiently uncomfortable would migrate to climates better suited to their physiology, if their physiology didn’t adapt to the environment; for example, my ancestors were from extreme cold environments, and I am without a doubt FAR more comfortable in 50 degree F weather in a T shirt than I am in 70 degree weather. And to me with the right clothing, everything down to and even below freezing is quite pleasant.
Prior to much modern technology, just surviving and staying alive as a human was a miserable, painful experience.
We have it so, so good today, compared to our ancestors just a hundred years ago, let alone thousands. Virtually every measure of human suffering (extreme poverty, starvation, sickness, death, etc) is dramatically lowering with each generation.
It is a wonderful thing that modern advancements allows us to be comfortable, which then further frees our minds to pursue even greater and more wonderful endeavors.