I wonder how this beast with AVX-512 compares to GPUs for AI model training and execution?
I'm sure GPUs would still be more efficient for the specialize task of heaps of matrix math, but given the insane price premium on high-end nVidia cards I wonder if this could be an alternative?
96 AVX512 cores is roughly 3072 parallel fp16 calculations per cycle.