It would be great if the infra layer can provide some help on automated resource scaling, especially for RAM. The ML solver/tooling layer has also been making progress on this front, for example Dask for limited-RAM pandas, h2o.ai has limited RAM solvers, xgboost has an external memory version, pytorch/tensorflow models are mostly trained on SGD and only needs to load data batch by batch. It's nice that Metaflow can integrate with any python code and thus benefit from all of the efforts made on the solver/tooling layer.
It's interesting that you're drawing the comparison with NiceHash. Snark AI will be a marketplace like NiceHash but targets mostly deep learning training and inference on the user end.
Yeah exactly. Hopefully AI computation market will grow big in time so those crypto-miners can pivot into more profitable business of GPU cloud for AI instead of selling the hardware in crypto downfall. In the long term, Snark AI wants to create the marketplace where all the qualified GPU providers can bid for the best market price which will benefit everyone.