So it's cherry picked examples in the demo page that fall apart at the lightest real world case. Just like GPT3 :-)
GPT-3 does shockingly well at classification tasks with basically 0 training/prompting (outside of the base model). And it works for an incredibly broad set of use cases.
But using QA and generation are much harder to judge because we can't say (in general) whether generated text is "correct"
That's a heck of a lot of training. It might seem to work if you ask it to repeat stuff that it has seen in the base model, but there's nothing reliable about that. Most attempts to find some practical use for AI language models have basically been failures.
> our expectations are wrong. For the vast majority of computing history, computers have been used to do things deterministically and accurately.
Actually, accuracy matters even when dealing with non-deterministic, statistical/random/sampled data. A lot of supposed 'AI' is little more than a glorified toy or party trick, founded on ad-hoc data mining rather than rigorous inference from a well-defined model.