I marvel at the jump in BLEU or other measures but I'll second the sentiment, it alone is not showing we are making leaps toward what we need. Yes its a large gradient step minimizing our error, but is it really in the right direction? However I will admit GPT-3 being directed by some yet to be invented causal or counterfactual inference model might be the something which defies my expectations.