They where working on the problem for a year using codex.

Models are very obviously continuously updated.

Model editing to remove PII that slipped through, all sorts of things of that sort.

pretraining is months but they can totally fine tune in a few days

They don't need to train a whole model. They can feed it new information and fine tune it.