This is most likely aimed at people running models locally.
And a homelab with 3090s/4090s is one or two orders of magnitude cheaper than GCP, if you use them continuously.
And a homelab with 3090s/4090s is one or two orders of magnitude cheaper than GCP, if you use them continuously.
I don't think 200gb ram is actually required, that's just what that cloud vm was spec'd with. Though the 175b model should see benefit with ram even beyond 200gb.