Good question. I have been compiling an analysis of the hardware market with the idea of analyzing a cloud market for LLMs. Feel free to comment: https://docs.google.com/document/d/1nehciIpaKj3-sEta5Jx2q9in...

I am mainly interested in the training side because it is the more difficult one.

Yes, Grayskull is Tenstorrent's entry-level devkit for inference only. Future generation of chips to feature training.

Correct, working on enabling training on next iterations