Yeah, models aren't good at code any more than they are good at people. They turn it out very fast, but that isn't actually useful when the code needs to be carefully reviewed to find the land mines and questionable design decisions.
This was true six months ago but today models are indeed excellent at coding especially if you give them guidance.