Sure, if you have a H100 cluster. If you quant it to int4 you might get away with using only 4 H100 GPUs!
Can anyone share the cost of their pre-built clusters, they’ve recently started selling? (sorry feeling lazy to research atm, I might do that later when I have more time).
https://smicro.eu/nvidia-hgx-h100-640gb-935-24287-0001-000-1
8x H100 HGX cluster for €250k + VAT