>What was hard there was to train the model head without ML expertise, and considerable amount of data

Which has become a lot easier the big, expensive general purpose LLMs

Some of the use cases seem interesting but a lot of them also seem like the "old" stuff can do it faster/cheaper