How much do 568 chips cost? What’s the cost ratio of it comparing to setup with roughly the same throughput using A100?
At that price 568 chips would be $11.7M
If they can get costs down and put more dies into each card then it'll be business/consumer friendly.
Let's see if they can scale production.
Also, where tf is the next coral chip, alphabet been slacking hard.
Fortunately LLMs and hard work of clever peeps running em on commodity hardware are starting to make this possible anyway.
Because Google Home/Assistant just seems to keep getting dumber and dumber...
> Accelerator Cards GroqCard low latency AI/ML Inference PCIe accelerator card with single GroqChip