This strikes me as kind of like saying that evolution is pseudoscience because 95% of professors in the field are not evangelical Christians, or something.
There may be other reasons to believe that implicit bias is pseudoscience, but "People who believe certain things about it tend to end up with personal worldviews that are consistent with their research" doesn't seem like one.