Likewise sometimes I am in my car and someone looks over at me. I think "wow if I was a girl I would think they are looking at me because of that!" (Because I tend to check out girls!)
My point is although there is no question you are subject to the actions you (and others describe) but it also could be the case that it happens for other reasons that have nothing to do with skin color. Make sense?
Lastly, while I am white, I am of a religion that has a percentage of the population that is biased against us. But for some reason I haven't really experienced that bad treatment that I can link to my religion. I think this is because my last name doesn't scream the religion as some others do.
One more thing. I'm married to a physician and I dated a physician. And when we are together people always assume I am the doctor or also a doctor. And they always seem to defer to me rather than my wife (or in the past girlfriend). My wife also has been treated by nurses without respect something they don't do to the male doctors.