What's weird, is that they are heuristic next token predictors. But that prediction, mixed with a little randomness is producing very seemingly "reasoned" responses.