>We cannot tell the difference between a color which is a mixture of two (or more) frequencies of light, and a pure color, whereas we can tell chords from notes. (In spite of notes having harmonics).

Wouldn't we have to be able to distinguish polarity to tell the difference?