> All you need to do is establish what the output means and you can fine-tune an LLM final layer for this task

Yeah, that was the original idea with GPT, Generative Pre-trained Transformer, and earlier open pre-trained transformers.

Today people use AI via APIs rather then fine-tuning models by themselves and when someone provides this as an API they got excited.