"Color" implies black, but it is also used to imply other colors sometimes. It can imply middle eastern, east asian, southeast asian, hispanic, and several other groups. However, aside from implying black, other implications are context-sensitive and as a result different authors sometimes mean very different things when they write "person of color".