> But whether this type of work will remain necessary in the long term im not sure.
Any and every capability AI can demonstrate today is the result of us, humans doing it in the first place for a very long time. The transfer method of these abilities is a subject of another comment, but as Microsoft and NVIDIA puts it, it's a theft of unprecedented scale [0].
AI labs dream of recursive self improvement as an escape from that, but until we arrive there, humans have to do something so AI can do it as well.
And, as of fully autonomous self driving which should have arrived 5 years ago, RSI and AGI is just around the corner, a corner with a radius so large that it never ends.
We dream of building utopias with these tools, but it's a path to dystopia paved with stones made from utopic dreams.