Socialization is an ambiguous, imprecise activity that demands infinitely many judgements, inferences, and preconceived rules & goals.
What can be interpreted as "jerk" behavior can also be caused by "dork" behavior, and vice-versa.
A joke at someone's expense might be expressing affinity for them or dissing them.
Adopting ebonics speech and tone in one context maybe in-group acceptable in one context, but insulting in another.
Ultimately, the algorithms need enough trial-and-error socializing experience to become, for lack of a better term, cool.
To be fair to the IAT, while it has very low test-retest reliability and lots and lots of state variance, there's definitely something in the reaction time differences that is meaningful. How meaningful it is, and whether or not it makes any practical difference remains to be determined.
Anyone who hasn't done one, try this link and see how you feel during the process: https://implicit.harvard.edu/implicit/takeatest.html
And at least there wasn't a massive profit motive behind the IAT, at the beginning anyway :)