Well, that depends. There is a chance it could get laughed off (are you black and joking about athleticism, or did you roll up wearing a hood?). It rests on if the audience chooses to see what was said as racial or racist? Just like my previous post was largely about who interpreted FHRITP as sexist, vs just sexual.
if you can't see the difference between the two [...]
Of course you don't want someone that disagrees with you over X making decisions on Y and Z. They don't share your value system and perspective.
Everyone is going to draw their interpretations from different value systems, and place their boundaries on sexist/sexual and acceptable/unacceptable boundaries at different points. The conversations that result over these topics are largely rote and boring. Where someone finds their personal lines is going to correlated to the set of cable networks they watch.