It's worse because their kids can't afford to buy a home now and they have to leave.
You also have to be able to afford to not sell when where you live gentrifies, prices for everything go up, local taxes go up, restaurants get fancier, services cost more, groceries go up, if you were renting then you get priced out.
Like I said it wasn't an ultimatum people were given to sell or keep their town, it didn't just spring on them one day in a town meeting where they could vote to gentrify or not.
Some people are going to sell because they're moving on, some people die and their estate sells, it's just going to happen. Over time more of them get sold to holidaymakers and investors, and you can start to pick up on what's happening, but it's not like you have personal agency over the problem anymore. You could refuse to sell, but your neighbor might not. Prices are going up, the town is changing whether you like it or not.
Think of a young couple, new kid, want a bigger house in their home town, no longer possible because their wages at the ski lodge don't actually let them afford a home the size they need. They sell their current one and leave. I'm not saying feel sorry for them, just using it as an example.
The market value of their home grew enormously, and with it their property taxes. They live frugally on a low, fixed income and eventually the tax burden grew too much. So yeah, they got a nice capital gain, but they had to move away from the home they bought as newlyweds and raised their family in. It probably would've been better for their children's inheritance if they hadn't sold the house, too.
Shit happens, I suppose.