Even at 100x cost decrease this will still cost $10,000 to beat a benchmark. It won't scale when you have that amount of compute requirements and power.

GPT-3 may massively reduced in cost, but it's requirements were not anyway extreme compared to this.