And maybe it's just the harness and the backing model is mostly the same. But I would expect Codex to give better responses to code questions than chatGpt using the "same" model.
I went back through Azure foundry, and it looks like they have gotten rid of reasoning variants, so might just be one model now.