The "You can loop forever using output as input but at some point the result will stop changing" idea seems more related to dynamics, feedback and attractor states.

If you have a feedback loop of "recursively improving" by generating synthetic data, to train on, to generate more synthetic data, etc, then this is indeed a matter of looping "using output as input", and without any other system inputs it would indeed "converge" to some attractor states.