Those additional sentences are fairly non-trivial to construct, would you agree?
653 karma · joined February 8, 2025
But that's just one piece of the puzzle, I guess.
Why are we so against, in principle, to the current pre-training scaling laws? Perhaps, we'll require new innovations at some point, but the momentum allows us to reach to newer heights that we've never climbed before.
Looks like a great project at surface!