All the problems in every serious piece of software I've ever worked on stem from the customer (be it external or in-house) not knowing what they want, the person in charge of capturing that doing a pretty bad job of it anyway, and the chain from there to the person writing the software taking that failure and making it worse.

AI writing software will just get me another flavour of the wrong software. AI working out what people want the software to do would be useful.