I tested it and it turns out LLMs can follow commands such as "Port the following Python code to COBOL", although it's certainly harder to validate the output is correct.
If the DOGE team have this bright idea of getting an LLM to mess with the COBOL on mainframes there is going to be widespread chaos beyond human imagination.