It's not just an American thing, it's the concept of a "demonym" -- and there are official and unofficial demonyms. For example, the official demonym of Massachusetts is "Bay Stater," but everyone uses the far more popular "masshole."