Probably a lot that we don't know about, because ChatGPT has better reasoning skills than most other systems out there, and we know reasoning is not really about the weights.