These models aren't capable of "doing" things. They can't necessarily calculate values etc. They can assemble text based (more or less) on statistical analysis of all their input data, and the are incredible at it... but if you ask what 2+2 is, its not doing math to get to 4.
They certainly can't deploy the code they generate etc.