Stochastic and unpredictability aren't exactly the same. I would claim current LLMs are generally predictable even if it is not as predictable as a deterministic program.
I also don’t think there is a reason to believe that self-learning models must be unpredictable.