Hacker News Reader

And OpenCL ("GeekBench 6 Compute") scores comparable with an RTX 2070:

https://browser.geekbench.com/opencl-benchmarks

doing a few sketchy conversions puts Metal compute performance closer in capability to an RTX 4070.

M3 Max is ~170% M1 Max per some graphic Apple released. That puts it at ~95% the performance of a 6800 XT on the Metal charts. RTX 4070 is ~95% the performance of the 6800 XT on the Vulkan charts.

That's not bad actually because bottleneck in training is in RAM and we can have 128gb...

I believe that Apple Silicone is still too slow for training. The big RAM is really useful for interference of big models though

If you’re training a model that needs 128gb, the GPU speed is going to be a “bottleneck”

Reply on news.ycombinator.com