Falling back on a RL pipeline to cover gaps always strikes me as a more sophisticated version of the mechanical turk. If what we had was truly AGI wouldn't they be able to derive this from the data they already have.
Why would we care wether something truly is AGI or not?
It is useful. It may be dangerous. It has an impact. I care about that.