It's very hard for me to remember colors, if someone cut their hair I'll notice it easily, but if they change color (e.g blonde to brown), I'll have an unsettling feeling but it's very hard for me to pinpoint what has changed.
When I'm asked to describe a person I'm extremely unlikely to give hair or skin color, and I can't even tell the color of the eyes of anyone of my family right now, I just don't know.
When I remember colors it's more like I remember a textual description. My eyes are green, I know because I remember it being written on my ID, not because I've seen them in the mirror this morning.