You have an incredibly optimistic view of current and especially future AI capability, that i dont see warranted.
> breakthroughs in formal verification
this happens to be quite an interest of mine, and can quite confidently say; hah, no. Formal verification of software is such a disproportionately high difficulty compared to writing software; and there is duck all training data. Your lucky if the LLM knows the syntax or standard library.
I'm curious what you work with given your dismissal of software engineering as a displine existing within 10 years.