Less chance of fatal-to-operator malfunctioning tho.
$30K<->$40K and it apparently costs Nvidia around $3.3K to manufacture an H100 GPU for info
Cost to produce doesn't matter. The reason these things are so expensive is demand and the limited capacity of fabs to produce them.
You pay mostly for CUDA, not the GPU
Anyone have any predictions about when the prices will start going down significantly? Anyone think we could see price per hour per GPU cut in half by July?
When some more EUV fabs come online. So... 5-10 years min.
Looks like we have a bunch of start-up cloud companies who have money being thrown at them by god knows who buying thousands of H100s and other GPUs. These are all going to come online around the same time in early spring. I think we will see prices drop rapidly by June .