Color is not uniquely American. It was used in England since before America’s discovery and is, in fact, more etymologically correct - it comes from the Latin word “color”. :)

The more French-influenced colour was more common in England, and obviously eventually did totally win out.

There are generally very similar stories for most “American” spellings.