crawl walk run.
no sense spending large amounts of compute on algorithms for new math unless you can prove it can crawl.
no sense spending large amounts of compute on algorithms for new math unless you can prove it can crawl.
It's also a more natural question to ask, since building projections on top of frozen foundation model embeddings is both common in an absolute sense, and much more common, relatively, than building projections off of tiny frozen networks like a ResNet-50.