There is a downside to living in college towns. I lived in a small Southern college town for three years while my now-wife got her second degree.
It's harder to find friends for people who aren't 19. You hang out with other graduate students, locals, or university employees your age, but the pool tends to be small.