Sure, but eventually we’re going to hit on environmental and cost-effective power limits of training, and it’s not worth the cost to train the model.
AFAIUI, that’s part of the point that Gebru was trying to make before she was fired.
AFAIUI, that’s part of the point that Gebru was trying to make before she was fired.
With an order of magnitude more parameters it won't just do hands, it will do quite a bit more.
Edit: to tie it back to the original criticism: what’s the maximum training cost we’re willing to accept for the model? How can we guarantee return greater than the increased training cost?
And training a real living breathing person in a rich OECD country is going to be costly - no offense meant, I'm actually not from OECD.
But then again, when it comes to commercial needs, a human doesn't need "retraining" every time you ask them to draw something they weren't familiar with when they went through art school...