That's standard practice afaik, it's a machine learning blackbox after all

Google ‘fixed’ its racist algorithm by removing gorillas from its image-labeling tech - https://www.theverge.com/2018/1/12/16882408/google-racist-go...