[Author] Good luck trying to use clusters of Lambda machines. Lambda labs are cheap for a reason: their API is not very featureful (we looked at them and we saw they didn't even support machine tagging). If you're looking for a box or two, lambda labs is fine. If you're looking for 1,000, not so much.

Plus they don't actually have any actually A100s available at the moment (2022-05-17).

CoreWeave is a nice middle ground. You can at least get the A100 machines into a k8s cluster.