I was on that side of the argument as well, but it seems that models can have emerging model states of a given situation

https://arxiv.org/abs/2210.13382