“From scratch” might be non-specific, but a fine phrasing in this case.
I'm glad this disgusting sloppiness doesn't exist in more established fields. I hope people keep calling it out.
Cute.
In this case my lens is colored by my interests; I've been thinking a lot on RL for LLMs and it slipped out here. For me I rely on phrases to quickly filter for (subjectively) interesting work. And assuming we value that subjective filtering of content, we make it easier for others to filter consistently when we use consistent language.
There are 2873 results that contain "large language model" in the full text and use "pretrained" in the title or abstract. A 10x difference in publication count does make one feel more common than the other?
I'd need to get into more involved queries to break down the semantic categories of those papers.
This is perfectly good language and exactly the correct thing for them to say.