While this is already terrible, I’m aware of a few project that are trying to do the same with scientific literature. Basically they are trying to train models for scoring literatures based on their quality, novelty and what not. At the current rate and state of AI, I cannot ever imagine this is going to work.
It was a few weeks ago that someone shared “The Dark Age of AI” on HN [1]. I think we are promising way over what Drew McDermott thought we would not going to promise. This is to the extend that we are applying AI on assessing Art, Creativity and even quality and novelty of Science, something that in a way we don’t even understand (or trying to understand) ourselves at the time that we are publishing it.