It can learn from it's own users. People paste their code into GPT for context, so it'll see new patterns that way. People paste the error message that results from some bad code GPT spit out, it learns from context plus the error text what the correct code should be.