Very case dependent of course. There are loads of small towns that have stagnant or shrinking populations all across the US.