What’s going on with that first graph? The scale changes from 1500” to 3000”, but Spark’s bar sizes stay the same.
Did Spark have a 2x slow down between the tests? It seems pretty misleading.
Did Spark have a 2x slow down between the tests? It seems pretty misleading.
In our original demo, we ran a V100 GPU against 8 CPU nodes. The new T4 GPUs cut our cost in half, which meant we reduced the Apache Spark cluster to 4 CPU nodes in order to maintain price parity. Even with the reduced GPU memory, the whole workload ran significantly faster.
... on the other hand, that's more difficult to measure, and TDP figures are not what really happens.