> I wonder what makes people think that an AI needs to be able to code to improve itself. I don't see infant brains "programming" themselves to get better.

That's largely because you haven't looked. Infants are constantly developing and pruning pathways and connections in their brain, which effectively changes both the hardware and the software.