I don't have anything other than personal experience to back this up, but I would be surprised if it's not a completely subjective experience—one person's synesthesia probably doesn't match another person's, per se.
Just curious for any musician's out there, when you're playing in the key of D dorian, for example, what colors go through your mind? F major? E minor?
All these have specific colors that tend to dominate my imagination.