Two thoughts on this:

1. someone could make a shitload of money building a tool for learning how to prompt engineer LLMs in a formal course setting. Would be better than most of the GPT grifts currently circulating.

2. the ETHZ writer, while having a generally good grasp, seems to not understand the concept of Attention here. Or that you can do additional training on these models (even just RLHF). I don't think I understand RLHF, Attention, or extra training (new NN layers right?) enough to comment further.