This, plus since you can't realistically run these LLMs at home, the motivation to get invested in them is not really there (for me at least)

I mean, yes I do find the mathematical background of LLMs fascinating, but it's not going to be something that I can put to practical use (much), if that makes sense?