The adoption of the so-called "Software 2.0" depends on how influential OpenAI is as a company. The majority of the use-cases of GPT-3 are only about "remixing" information, and the "notoriety" of the AI is (IMO) mostly a publicity stunt; I'm assuming that there are prompts for personalities / jokes / poems / etc that are never shown to the end-user and are hailed as an "organic outcome" of the model. Obviously, no one can check for these right now. Seems to me that microsoft has taken a few leaves out of the OpenAI playbook and applied them (rather chaotically).

So when you're looking at actually writing software that needs to be dependable / modifiable / bug free, you'd need a massive overhaul of whatever software stack is being used, so there's very little human-assisting "cruft", and instead you'd want a lot of supporting material for a model, which might look like something written in languages used for formal verification of programs.

The promise of GOFAI was about having a human-understandable bottom-to-top framework, and the current "AI" paradigm is at odds with it. The "formal verification" assumption, then, skews towards GOFAI. But since there has to be some human support for the current not-there-yet AI to write software, we might see yet another abstraction layer based on NN / something newer in the years to come.